Budgeted Broadcast: An Activity-Dependent Pruning Rule for Neural Network Efficiency

Yaron Meirovitch, Fuming Yang, Jeff Lichtman +1

Most pruning methods remove parameters ranked by impact on loss (e.g., magnitude or gradient). We propose Budgeted Broadcast (BB), which gives each unit a local traffic budget (the…