Why and When Neural Networks Improve Local Approximation in Optimization

Chengkuo Bian, Pengcheng Xie

Published experience with neural surrogates in derivative-free optimisation is contradictory: the same family of models that cuts the evaluation count of one solver leaves another…