Structured Pruning Adapters

Lukas Hedegaard, Aman Alok, Juby Jose +1

Adapters are a parameter-efficient alternative to fine-tuning, which augment a frozen base network to learn new tasks. Yet, the inference of the adapted model is often slower than…