Non-identifiability distinguishes Neural Networks among Parametric Models

Sourav Chatterjee, Timothy Sudijono

One of the enduring problems surrounding neural networks is to identify the factors that differentiate them from traditional statistical models. We prove a pair of results which di…