Depth-Aware Initialization for Stable and Efficient Neural Network Training

Vijay Pandey

In past few years, various initialization schemes have been proposed. These schemes are glorot initialization, He initialization, initialization using orthogonal matrix, random wal…