A Robust Initialization of Residual Blocks for Effective ResNet Training without Batch Normalization

Enrico Civitelli, Alessio Sortino, Matteo Lapucci +2

Batch Normalization is an essential component of all state-of-the-art neural networks architectures. However, since it introduces many practical issues, much recent research has be…