Training Structured Neural Networks Through Manifold Identification and Variance Reduction

Zih-Syuan Huang, Ching-pei Lee

This paper proposes an algorithm (RMDA) for training neural networks (NNs) with a regularization term for promoting desired structures. RMDA does not incur computation additional t…