A Complete Symmetry Classification of Shallow ReLU Networks

Pranavkrishnan Ramakrishnan

Parameter space is not function space for neural network architectures. This fact, investigated as early as the 1990s under terms such as ``reverse engineering," or ``parameter ide…