1 citations · 1 across the 2 of their papers we have counts for
1 paper · 1 filter
Tatsuhiro Nakamori, Laura Gomezjurado Gonzalez, Ganesh Talluri +5
Low-rank gradient compression reduces communication in distributed training by representing updates with rank-r factors. Dion is a recent method that approximates Muon, a spectra…