The Expressivity and Training of Deep Neural Networks: toward the Edge of Chaos?

Gege Zhang, Gangwei Li, Ningwei Shen +1

Expressivity is one of the most significant issues in assessing neural networks. In this paper, we provide a quantitative analysis of the expressivity for the deep neural network (…