Transfer Learning for Structured Pruning under Limited Task Data

Lucio Dery, David Grangier, Awni Hannun

Large, pre-trained models are problematic to use in resource constrained applications. Fortunately, task-aware structured pruning methods offer a solution. These approaches reduce…