2 papers
cs.DC2026
Heddle: Learning Structural Templates for Parallelism Planning on Heterogeneous GPU Clusters
Taeyoon Kim, Yonguk Song, Seoyeong Choy +4
Training large machine learning models on shared GPU infrastructures faces two challenges: (1) GPU availability shifts dynamically with varying resource demands from tenants, and (…
cs.DC2026
Distributed Generative Inference of LLM at Internet Scales with Multi-Dimensional Communication Optimization
Jiu Chen, Shuangyan Yang, Xu Xiong +4
Decentralized LLM inference distributes computation among heterogeneous nodes across the internet, offering a performant and cost-efficient solution, alternative to traditional cen…