The silence of the weights: a structural pruning strategy for attention-based audio signal architectures with second order metrics

Andrea Diecidue, Carlo Alberto Barbano, Piero Fraternali +2

Transformer-based models have become the state of the art across multiple domains, from natural language processing to machine listening, thanks to the attention mechanisms. Howeve…