Optimizing the optimizer for data driven deep neural networks and physics informed neural networks

John Taylor, Wenyi Wang, Biswajit Bala +1

We investigate the role of the optimizer in determining the quality of the model fit for neural networks with a small to medium number of parameters. We study the performance of Ad…