Towards Robust Calibration Dataset for Domain-General Mixture of Experts Pruning

Luis Frentzen Salim, Chia-Chun Wu, Tran Van Nhiem +2

Post-training expert pruning is a promising deployment technique for Mixture-of-Experts (MoE) models. The calibration set is an integral part of the pruning process, however, its c…