Never look back - A modified EnKF method and its application to the training of neural networks without back propagation

Eldad Haber, Felix Lucka, Lars Ruthotto

In this work, we present a new derivative-free optimization method and investigate its use for training neural networks. Our method is motivated by the Ensemble Kalman Filter (EnKF…