Deep Residual Networks and Weight Initialization

Masato Taki

Residual Network (ResNet) is the state-of-the-art architecture that realizes successful training of really deep neural network. It is also known that good weight initialization of…