Interplay between depth of neural networks and locality of target functions

Takashi Mori, Masahito Ueda

It has been recognized that heavily overparameterized deep neural networks (DNNs) exhibit surprisingly good generalization performance in various machine-learning tasks. Although b…