These DGX A100 systems are connected over an Nvidia Quantum 200 GB/s InfiniBand fabric, which Meta said will make it the “one of the largest such networks” when the full cluster is completed.
But to connect hundreds — and eventually thousands — of Nvidia’s DGX A100 systems together ... later this year when the full cluster of 16,000 Nvidia A100 GPUs goes online.
The final 16 nodes consist of two Intel Ice Lake Xeon Gold 6330 28-core processors, dual Nvidia A100 GPU, 512GB of memory and 960GB of local scratch. Currently, there are high-bandwidth memory compute ...
An NVIDIA DGX SuperPOD with DGX A100 systems is being replaced by the new NVIDIA DGX SuperPOD with 63 NVIDIA DGX B200 systems. The systems include the NVIDIA AI Enterprise software platform and ...