All you need is a good init

Dmytro Mishkin, Jiri Matas

Layer-sequential unit-variance (LSUV) initialization - a simple method for weight initialization for deep net learning - is proposed. The method consists of the two steps. First, p…