Neural Approximation by Function Composition: Rigidity and Doubly Exponential Convergence

Wentao Huang, Haizhang Zhang

Deep neural networks approximate functions by composing affine maps with nonlinear activations, but how composition itself creates approximation power is not yet fully understood.…