Optimal Pruning for Neural Architectures using Fisher Information Distances

David S. Berman, Yen-Yu Fu, Edward Hirst +1

A new scheme for parameter pruning is introduced, derived from the differential-geometric distance in model space. Pruning a parameter sets its value to zero, representing a displa…