Colla-Q: Toward Collaborative Experts in MoE Quantization via Minimax Precision Balancing

Eunju Shin, Jongbin Ryu

In this paper, we present a Mixture-of-Experts (MoE) quantization method based on activation entropy. Although quantization reduces memory and computational costs, it can substanti…