With the A100 already in full production, Nvidia is taking the GPU to market in multiple ways: with the eight-GPU DGX A100 deep learning system that will cost $200,000, with the HGX A100 server ...

Alternatively, eight of the GPUs can be linked with Nvidia's third-generation NVLink interconnect to act as one giant GPU in the DGX A100 or a server using Nvidia's HGX A100 board. But key to the ...

By comparison, Nvidia's densest HGX/DGX A100 systems top out at eight GPUs ... a modest advantage in performance over an Nvidia A100 GPU, though it falls behind in both memory capacity and bandwidth.