Discovering Symmetries in Neural Network Parameter Spaces

Bo Zhao, Nima Dehmamy, Robin Walters +1

Parameter space symmetries are important for understanding neural networks' loss landscape, training dynamics, and generalization. However, systematically identifying these symmetr…