Natural Neural Networks

Guillaume Desjardins, Karen Simonyan, Razvan Pascanu +1

We introduce Natural Neural Networks, a novel family of algorithms that speed up convergence by adapting their internal representation during training to improve conditioning of th…