25 citations · 64 across the 6 of their papers we have counts for
6 papers
In-Network Collective Operations: Game Changer or Challenge for AI Workloads?
Torsten Hoefler, Mikhail Khalilov, Josiah Clark +9
This paper summarizes the opportunities of in-network collective operations (INC) for accelerated collective operations in AI workloads. We provide sufficient detail to make this i…
Flowcut Switching: High-Performance Adaptive Routing with In-Order Delivery Guarantees
Tommaso Bonato, Daniele De Sensi, Salvatore Di Girolamo +4
Network latency severely impacts the performance of applications running on supercomputers. Adaptive routing algorithms route packets over different available paths to reduce laten…
Exploring GPU-to-GPU Communication: Insights into Supercomputer Interconnects
Daniele De Sensi, Lorenzo Pichetti, Flavio Vella +11
Multi-GPU nodes are increasingly common in the rapidly evolving landscape of exascale supercomputers. On these systems, GPUs on the same node are connected through dedicated networ…
Datacenter Ethernet and RDMA: Issues at Hyperscale
Torsten Hoefler, Duncan Roweth, Keith Underwood +9
We observe that emerging artificial intelligence, high-performance computing, and storage workloads pose new challenges for large-scale datacenter networking. RDMA over Converged E…
An In-Depth Analysis of the Slingshot Interconnect
Daniele De Sensi, Salvatore Di Girolamo, Kim H. McMahon +2
The interconnect is one of the most critical components in large scale computing systems, and its impact on the performance of applications is going to increase with the system siz…
Network-Accelerated Non-Contiguous Memory Transfers
Salvatore Di Girolamo, Konstantin Taranov, Andreas Kurth +7
Applications often communicate data that is non-contiguous in the send- or the receive-buffer, e.g., when exchanging a column of a matrix stored in row-major order. While non-conti…