Showing cs.LGShow all
2 papers · 1 filter
cs.LG2025
Local Diffusion Models and Phases of Data Distributions
Fangjun Hu, Guangkuo Liu, Yifan F. Zhang +1
As a class of generative artificial intelligence frameworks inspired by statistical physics, diffusion models have shown extraordinary performance in synthesizing complicated data…
cs.LG2025
DiLoCoX: A Low-Communication Large-Scale Training Framework for Decentralized Cluster
Ji Qi, WenPeng Zhu, Li Li +6
The distributed training of foundation models, particularly large language models (LLMs), demands a high level of communication. Consequently, it is highly dependent on a centraliz…