Articles by tag "NVIDIA networking"

1. Maximizing MFU: How NVIDIA SHARP™ Inside MQM8790 Accelerates PyTorch Multi-Node Training
   Selene Gong

   18
   Quick Take NVIDIA SHARP™ inside the MQM8790 switch ASIC flattens the distributed training degradation curve by offloading collective AllReduce calculations from the GPU nodes directly into the network fabric. This in-network reduction reduces cross-tier traffic volume, minimizes ...