Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
Dimension-Free Saddle-Point Escape in Muon
Yanlin Long, Yufei Gu, Zeke Xie
Modern Large Language Model (LLM) training is fundamentally bottlenecked by pathologically flat saddle points in extreme high-dimensional landscapes. Motivated by this challenge, w…
cs.LG2026
Mano: Restriking Manifold Optimization for LLM Training
Yufei Gu, Zeke Xie
While large language models (LLMs) have emerged as a significant advancement in artificial intelligence, the hardware and computational costs for training LLMs are also significant…