Orthogonal Over-Parameterized Training

Weiyang Liu, Rongmei Lin, Zhen Liu +5

The inductive bias of a neural network is largely determined by the architecture and the training algorithm. To achieve good generalization, how to effectively train a neural netwo…