Geometry of Linear Neural Networks: Equivariance and Invariance under Permutation Groups

Kathlén Kohn, Anna-Laura Sattelberger, Vahid Shahverdi

The set of functions parameterized by a linear fully-connected neural network is a determinantal variety. We investigate the subvariety of functions that are equivariant or invaria…