Scaling and Resizing Symmetry in Feedforward Networks

Carlos Cardona

Weights initialization in deep neural networks have a strong impact on the speed of converge of the learning map. Recent studies have shown that in the case of random initializatio…