Weight Conditioning for Smooth Optimization of Neural Networks

Hemanth Saratchandran, Thomas X. Wang, Simon Lucey

In this article, we introduce a novel normalization technique for neural network weight matrices, which we term weight conditioning. This approach aims to narrow the gap between th…