Beyond Expert Rankings: Contrast Calibration for Mixed-Precision MoE Quantization

Renjie Xie, Juncheng Yang, Aoting Hu +5

Mixture-of-experts (MoE) language models activate only a few experts per token, yet all expert weights must be stored. Mixed-precision quantization reduces this storage cost by ass…