EAQuant: Enhancing Post-Training Quantization for MoE Models via Expert-Aware Optimization

Zhongqian Fu, Tianyi Zhao, Ning Ding +4

Mixture-of-Experts (MoE) models enable scalable computation and performance in large-scale deep learning but face quantization challenges due to sparse expert activation and dynami…