From the 1 of 4 linked papers with an AI index.
4 papers
Incast-Free MoE Rate-Based Scheduling
Evyatar Cohen, Jose Yallouz, Alexander Shpiner +3
The paper shows that round-robin scheduling in Mixture of Experts (MoE) models creates an exponential incast problem, and introduces a proactive fair rate‑based scheduling framewor…
Avoiding Cross-Datacenter Collective Congestion via Disaggregated Buffering
Mariano Scazzariello, Noga H. Rotman, Dima Gavrilenko +6
LLM training at the scale of tens of thousands of GPUs now spans multiple datacenters (DC), making cross-DC collectives over long-haul links unavoidable. A critical and overlooked…
Congestion Control for Spraying with Congested Paths
Barak Gerstein, Mark Silberstein, Isaac Keslassy
Packet spraying approaches are increasingly deployed in datacenter networks. However, their combination with existing congestion control algorithms (CCAs) may lead to poor QoS, esp…
RFSeek and Ye Shall Find
Noga H. Rotman, Tiago Ferreira, Hila Peleg +2
Requests for Comments (RFCs) are extensive specification documents for network protocols, but their prose-based format and their considerable length often impede precise operationa…