20 citations · 86 across the 19 of their papers we have counts for
1 paper · 1 filter
Yuxuan Lou, Yang You
Muon fixes the \emph{direction} of every matrix-valued update at the polar factor of its momentum, while each layer's step \emph{magnitude} is addressed only by a static shape corr…