Showing cs.LGShow all
3 papers · 1 filter
cs.LG2026
Understanding the Weight Averaging Mechanism in LLM Training for Post-Training Quantization
Hanzhang Wang, Tianqi Shen, Zonglin Liu +3
Large language models (LLMs) are typically pretrained in high precision but increasingly deployed with low-precision post-training quantization (PTQ). Recent studies have shown tha…
cs.LG2026
Towards Understanding the Power and Limits of the Muon Optimizer: A River-Valley Perspective
Tianqi Shen, Jinji Yang, Runze Shi +3
Recently, Muon has gained substantial attention as an appealing alternative to Adam-like optimizers, with many works highlighting its advantages through spectral normalization and…
cs.LG2026
Escaping Local Minima Provably in Non-convex Matrix Sensing: A Deterministic Framework via Simulated Lifting
Tianqi Shen, Jinji Yang, Junze He +3
Low-rank matrix sensing is a fundamental yet challenging nonconvex problem whose optimization landscape typically contains numerous spurious local minima, making it difficult for g…