Layerwise Decoupling for Stable Structured Sparsification of Fully Connected Layers

Charles Kulick, Armenak Petrosyan, Sui Tang

We propose a decoupled, layerwise method for structurally sparsifying the fully connected layers of pretrained neural networks. Rather than penalizing all layers jointly, our appro…