14 citations · 18 across the 13 of their papers we have counts for
1 paper · 2 filters
Sagi Shaier
We propose Excitation, a novel optimization framework designed to accelerate learning in sparse architectures such as Mixture-of-Experts (MoEs). Unlike traditional optimizers that…