Convolution Aware Initialization

Armen Aghajanyan

Initialization of parameters in deep neural networks has been shown to have a big impact on the performance of the networks (Mishkin & Matas, 2015). The initialization scheme devis…