Delta Decompression for MoE-based LLMs Compression

Hao Gu, Wei Li, Lujun Li +5

Mixture-of-Experts (MoE) architectures in large language models (LLMs) achieve exceptional performance, but face prohibitive storage and memory requirements. To address these chall…