1 citations · 1 across the 2 of their papers we have counts for
3 papers
cs.DC2026
A Distributed View from a Single GPU: RankLens for Distributed Training
Yufan Wang, Yihao Zhang, Yi Liu
Modern distributed training is costly to debug, tune, and analyze because faithful analysis often requires repeated target-scale executions. We observe that many analysis tasks dep…
cs.DC2026
Revealing the Challenges of Attention-FFN Disaggregation for Modern MoE Models and Hardware Systems
Guowei Liu, Hongming Li, Yaning Guo +5
Deploying large-scale MoE models presents challenges in memory capacity and bandwidth for expert activation. While Attention-FFN Disaggregation (AFD) has emerged as a potential arc…
cs.LG2024★ 1 cited
FTuner: A Fast Dynamic Shape Tensors Program Auto-Tuner for Deep Learning Compilers
Pengyu Mu, Linquan Wei, Yi Liu +1
Many artificial intelligence models process input data of different lengths and resolutions, making the shape of the tensors dynamic. The performance of these models depends on the…