AMUSE: Anytime Muon with Stable Gradient Evaluation

Jueun Kim, Baekrok Shin, Jihun Yun +3

Modern deep learning commonly relies on AdamW with prescribed learning rate schedules, but recent works challenge both components: Schedule-Free optimization removes explicit sched…