Towards optimal hierarchical training of neural networks

Michael Feischl, Alexander Rieder, Fabian Zehetgruber

We propose a hierarchical training algorithm for standard feed-forward neural networks that adaptively extends the network architecture as soon as the optimization reaches a statio…