Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
Spectral Flattening Is All Muon Needs: How Orthogonalization Controls Learning Rate and Convergence
Tien-Phat Nguyen, Truong Nguyen, Minh-Phuc Truong +3
Muon orthogonalizes the momentum buffer before each update, replacing its singular values with ones via Newton-Schulz iterations. This simple change lets Muon tolerate far larger l…
cs.LG2026
ATLAS: Verifier-Guided Adaptive Latent Activation Steering for Efficient LLM Reasoning
Tuc Nguyen, Thai Le
Recent work on activation and latent steering has demonstrated that modifying internal representations can effectively guide large language models (LLMs) toward improved reasoning…