1 paper · 1 filter
Tate Berenbaum, Matias Parij, Muthaiah Venkatachalam
Mixture-of-experts models make nearly trillion-parameter capacity accessible with sparse per-token computation, provided that the serving system can distribute the weights and coor…