17 citations · 30 across the 10 of their papers we have counts for
4 papers · 1 filter
Partition of unity networks: deep hp-approximation
Kookjin Lee, Nathaniel A. Trask, Ravi G. Patel +2
Approximation theorists have established best-in-class optimal approximation rates of deep neural networks by utilizing their ability to simultaneously emulate partitions of unity…
A block coordinate descent optimizer for classification problems exploiting convexity
Ravi G. Patel, Nathaniel A. Trask, Mamikon A. Gulian +1
Second-order optimizers hold intriguing potential for deep learning, but suffer from increased cost and sensitivity to the non-convexity of the loss surface as compared to gradient…
Multilevel Initialization for Layer-Parallel Deep Neural Network Training
Eric C. Cyr, Stefanie Günther, Jacob B. Schroder
This paper investigates multilevel initialization strategies for training very deep neural networks with a layer-parallel multigrid solver. The scheme is based on the continuous in…
Robust Training and Initialization of Deep Neural Networks: An Adaptive Basis Viewpoint
Eric C. Cyr, Mamikon A. Gulian, Ravi G. Patel +2
Motivated by the gap between theoretical optimal approximation rates of deep neural networks (DNNs) and the accuracy realized in practice, we seek to improve the training of DNNs.…