Showing cs.DCShow all
3 papers · 1 filter
cs.DC2026
Diamond Agent: Agentic Control of Federated HPC Resources as a Service
Haotian Xie, Junlin Chen, Mingkai Zheng +9
Efficiently aggregating and orchestrating computing power across heterogeneous clusters for HPC workflows faces four practical challenges: preserving workflow context across indepe…
cs.DC2026
GIFT: Geometry-Informed Low-precision Gradient Communication for LLM Pretraining
Jieying Wang, Shuyuan Fan, Mingkai Zheng +1
Gradient communication is a primary scaling bottleneck in large language model (LLM) pretraining. Communicating gradients in low-precision formats, such as FP8 and NVFP4, can signi…
cs.DC2025
Efficient Fine-Grained GPU Performance Modeling for Distributed Deep Learning of LLM
Biyao Zhang, Mingkai Zheng, Debargha Ganguly +4
Training Large Language Models(LLMs) is one of the most compute-intensive tasks in high-performance computing. Predicting end-to-end training time for multi-billion parameter model…