1 paper · 1 filter
Jack Cashman, Jiaqi Nie
The QMoE model provides a practical approach for compression of massive Mixture-of-Experts (MoE) models. QMoE offers a solution geared towards memory limitations that often reach t…