10 citations · 28 across the 3 of their papers we have counts for
3 papers
cs.DC2025★ 10 cited
MPipeMoE: Memory Efficient MoE for Pre-trained Models with Adaptive Pipeline Parallelism
Zheng Zhang, Donglin Yang, Yaqi Xia +4
Recently, Mixture-of-Experts (MoE) has become one of the most popular techniques to scale pre-trained models to extraordinarily large sizes. Dynamic activation of experts allows fo…
cs.DC2025★ 9 cited
MCFuser: High-Performance and Rapid Fusion of Memory-Bound Compute-Intensive Operators
Zheng Zhang, Donglin Yang, Xiaobo Zhou +1
Operator fusion, a key technique to improve data locality and alleviate GPU memory bandwidth pressure, often fails to extend to the fusion of multiple compute-intensive operators d…
cs.CL2022★ 9 cited
BLISS: Robust Sequence-to-Sequence Learning via Self-Supervised Input Representation
Zheng Zhang, Liang Ding, Dazhao Cheng +3
Data augmentations (DA) are the cores to achieving robust sequence-to-sequence learning on various natural language processing (NLP) tasks. However, most of the DA approaches force…