A Nonlinear Singular Value Theory for Neural Networks

Brian Charles Brown, Robert Bridges, David Grimsman +2

Recently Brown et al. [2025] established a singular value decomposition (SVD) for maps (especially nonlinear) satisfying certain norm conditions. We prove that most modern neural a…