The Need for Speed: Pruning Transformers with One Recipe

Samir Khaki, Konstantinos N. Plataniotis

We introduce the $\text{O}$ne-shot $\text{P}$runing $\text{T}$echnique for $\text{I}$nterchangeable $\text{N}$etworks ($\text{OPTIN}$) framework as a tool to increase t…