Speech Block Influence: Component-Specific Layer Scoring for Pruning Speech LLMs

Siyu Yao, Du Q. Huynh, Lian Xu +1

Speech LLMs are costly to deploy in resource-constrained settings. Layer pruning can cut this cost, but existing scoring metrics transfer poorly to speech LLMs: they assume a decod…