Optimal Input Gain: All You Need to Supercharge a Feed-Forward Neural Network

Chinmay Rane, Kanishka Tyagi, Sanjeev Malalur +2

Linear transformation of the inputs alters the training performance of feed-forward networks that are otherwise equivalent. However, most linear transforms are viewed as a pre-proc…