Impact of Bottleneck Layers and Skip Connections on the Generalization of Linear Denoising Autoencoders

Jonghyun Ham, Maximilian Fleissner, Debarghya Ghoshdastidar

Modern deep neural networks exhibit strong generalization even in highly overparameterized regimes. Significant progress has been made to understand this phenomenon in the context…