Residual Sparsification via Output Importance for Compressing Mixture-of-Experts LLMs

Seungwoo Jung, Dohyeok Kwon, Seungmin Cha +4

Mixture-of-experts (MoE) architectures scale large language models efficiently, but they demand massive GPU memory. To cope with such demand, models are commonly compressed to redu…