36 citations · 57 across the 6 of their papers we have counts for
Showing 2017 · cs.LGShow all
2 papers · 2 filters
cs.LG2017★ 9 cited
Nonparametric Neural Networks
George Philipp, Jaime G. Carbonell
Automatically determining the optimal size of a neural network for a given task without prior information currently requires an expensive global search and training many networks f…
cs.LG2017★ 36 cited
The exploding gradient problem demystified - definition, prevalence, impact, origin, tradeoffs, and solutions
George Philipp, Dawn Song, Jaime G. Carbonell
Whereas it is believed that techniques such as Adam, batch normalization and, more recently, SeLU nonlinearities "solve" the exploding gradient problem, we show that this is not th…