Population Gradients improve performance across data-sets and architectures in object classification

Yurika Sakai, Andrey Kormilitzin, Qiang Liu +1

The most successful methods such as ReLU transfer functions, batch normalization, Xavier initialization, dropout, learning rate decay, or dynamic optimizers, have become standards…