PRIME: Frequency-Aware Unified Pruning and Merging for MoE Compression

Shanfeng Huang, Rongqian Zhang, Zhou Fang +2

Mixture-of-Experts (MoE) models have emerged as an effective paradigm for scaling large language models, yet their massive parameter footprint poses severe memory challenges for de…