High-speed Networking for Giga-Scale AI Factories

Sajy Khashab, Albert Gran Alcoz, Alon Gal +11

As distributed model training scales to span hundreds of thousands of GPUs, scale-out networks face unprecedented performance and efficiency demands. NVIDIA Spectrum-X Ethernet has…