PW-Pruning: Phase-Aware Expert Selection for Speech-Centric Omni-Modal Models

Junjie Cao, Fengping Tian, Wenjie Zhou +5

Sparse routing reduces per-token computation but leaves the full expert bank resident in memory. We study expert pruning for speech-centric omni-modal models, where pooling calibra…