Showing 2026Show all
2 papers · 1 filter
cs.CL2026
Mechanism-Aligned Observability for Training Instability of Large Language Models
Ruixuan Huang, Yipei Wang, Hantao Huang +7
Frontier large language model training consumes massive accelerator fleets over long wall-clock times, making stability failures extremely costly. However, global symptoms such as…
cs.LG2026
Understanding the Robustness of Distributed Self-Supervised Learning Frameworks Against Non-IID Data
Xuanyu Chen, Nan Yang, Shuai Wang +1
Recent research has introduced distributed self-supervised learning (D-SSL) approaches to leverage vast amounts of unlabeled decentralized data. However, D-SSL faces the critical c…