most citedSTAlloc: Enhancing Memory Efficiency in Large-Scale Model Training with Spatio-Temporal Planning

1 citations · 1 across the 6 of their papers we have counts for

collaborators
Showing cs.DCShow all

1 paper · 1 filter

cs.DC2025

FUSCO: High-Performance Distributed Data Shuffling via Transformation-Communication Fusion

Zhuoran Zhu, Chunyang Zhu, Hao Lin +9

Large-scale Mixture-of-Experts (MoE) models rely on \emph{expert parallelism} for efficient training and inference, which splits experts across devices and necessitates distributed…