Showing cs.CLShow all
2 papers · 1 filter
cs.CL2026
EchoDistill: Robust Large Audio Language Models via Noisy-to-Clean Self-Distillation
Liang Lin, Chunxi Luo, Kaiwen Luo +12
Large Audio Language Models (LALMs) remain vulnerable to acoustic noise, which can obscure task-relevant evidence and produce unreliable responses. We propose EchoDistill, a noisy-…
cs.CL2025
DiEP: Adaptive Mixture-of-Experts Compression through Differentiable Expert Pruning
Sikai Bai, Haoxi Li, Jie Zhang +2
Despite the significant breakthrough of Mixture-of-Experts (MoE), the increasing scale of these MoE models presents huge memory and storage challenges. Existing MoE pruning methods…