Correspondence between neuroevolution and gradient descent

Stephen Whitelam, Viktor Selin, Sang-Won Park +1

We show analytically that training a neural network by conditioned stochastic mutation or neuroevolution of its weights is equivalent, in the limit of small mutations, to gradient…