Articles by tag "RoCE v2"

1. Optimizing AI Inference Clusters: MCX7 AAS-NEAT Adapters
   Selene Gong

   18
   As the demand for Large Language Models (LLMs) and generative AI surges across Singapore and APAC, GPU-as-a-Service (GPUaaS) providers and AI engineers face a critical challenge: your inference cluster is only as fast as its network. Microsecond delays in transferring KV caches or synchronizing ...
2. Liquid Cooling Ready: Mellanox Switches for 100kW+ Rack Density
   Selene Gong

   18
   As AI workloads surge in 2026, data center architects (DCAs) and GPUaaS providers in Singapore and APAC face a harsh reality: next-generation GPUs like Blackwell GB200 NVL72 push rack power densities beyond 140kW. In such extreme environments, traditional air-cooled switches cannot maintain ...