Partitioned integrators for thermodynamic parameterization of neural networks

Benedict Leimkuhler, Charles Matthews, Tiffany Vlaar

Traditionally, neural networks are parameterized using optimization procedures such as stochastic gradient descent, RMSProp and ADAM. These procedures tend to drive the parameters…