Conceptual capacity and effective complexity of neural networks

Lech Szymanski, Brendan McCane, Craig Atkinson

We propose a complexity measure of a neural network mapping function based on the diversity of the set of tangent spaces from different inputs. Treating each tangent space as a lin…