Deep, Skinny Neural Networks are not Universal Approximators

Jesse Johnson

In order to choose a neural network architecture that will be effective for a particular modeling problem, one must understand the limitations imposed by each of the potential opti…