Complexity for deep neural networks and other characteristics of deep feature representations

Romuald A. Janik, Przemek Witaszczyk

We define a notion of complexity, which quantifies the nonlinearity of the computation of a neural network, as well as a complementary measure of the effective dimension of feature…