108 streaming multiprocessors and 40 GB of GPU memory within a 400-watt power envelope. With the A100 already in full production, Nvidia is taking the GPU to market in multiple ways: with the ...

Whereas the A100 has a chip-to-chip bandwidth of 600 GB/s ... cooling [and] price [standpoint]—all of those things—and then they select the right parts,” he said. Nvidia’s A800 40GB ...