1 citations · 1 across the 2 of their papers we have counts for
2 papers
cs.LG2026
MoEBlaze: Breaking the Memory Wall for Efficient MoE Training on Modern GPUs
Jiyuan Zhang, Yining Liu, Siqi Yan +6
The pervasive "memory wall" bottleneck is significantly amplified in modern large-scale Mixture-of-Experts (MoE) architectures. MoE's inherent architectural sparsity leads to spars…
cs.LG2024★ 1 cited
Disaggregated Multi-Tower: Topology-aware Modeling Technique for Efficient Large-Scale Recommendation
Liang Luo, Buyun Zhang, Michael Tsang +11
We study a mismatch between the deep learning recommendation models' flat architecture, common distributed training paradigm and hierarchical data center topology. To address the a…