Articles by tag "SmartNIC"

1. NVIDIA ConnectX-7 MCX755106AS-HEAT Deployment & Compatibility Guide
   Selene Gong

   18
   When you are orchestrating a multi-node GPU cluster for Large Language Model (LLM) training and notice sudden training epoch stalls or microburst packet drops during All-Reduce collective communication phases, the bottleneck is rarely the GPU itself—it is almost always the network interface ...
2. Is NVIDIA MCX755106AS-HEAT ConnectX-7 SmartNIC Worth It for AI Servers?
   Selene Gong

   18
   When you are executing a multi-node LLM training run across a cluster of H100 or A100 GPU servers and start noticing sudden, unexplained training epoch stalls, the culprit is rarely the compute silicon. Instead, it is almost always a networking bottleneck: packet drops under heavy RoCEv2 (RDMA ...
3. NVIDIA ConnectX-6 Dx vs ConnectX-7: Sizing SmartNICs for AI Servers & Private Cloud
   Selene Gong

   18
   Quick Take The NVIDIA ConnectX-7 is the definitive standard for PCIe Gen5 AI superclusters requiring GPUDirect RDMA and 400G throughput, whereas the ConnectX-6 Dx remains the most cost-effective, high-performance SmartNIC for PCIe Gen4 enterprise private clouds and virtualized storage. ...