Theoretical Analysis of the Advantage of Deepening Neural Networks

Yasushi Esaki, Yuta Nakahara, Toshiyasu Matsushima

We propose two new criteria to understand the advantage of deepening neural networks. It is important to know the expressivity of functions computable by deep neural networks in or…