Neural Nets with a Newton Conjugate Gradient Method on Multiple GPUs

Severin Reiz, Tobias Neckel, Hans-Joachim Bungartz

Training deep neural networks consumes increasing computational resource shares in many compute centers. Often, a brute force approach to obtain hyperparameter values is employed.…