Benchmarking Composable Compression Techniques in Mixture-of-Experts LLMs

Afsara Benazir, Chen Chen, Rongxiao Qu +3

Mixture-of-Experts (MoE) LLMs scale model capacity efficiently through sparse activation, but their large expert parameter footprint, routing imbalance, and long-context KV-cache g…