3 papers
cs.LG2025
Symmetry in Neural Network Parameter Spaces
Bo Zhao, Robin Walters, Rose Yu
Modern deep learning models are highly overparameterized, resulting in large sets of parameter configurations that yield the same outputs. A significant portion of this redundancy…
cs.LG2025
Understanding Mode Connectivity via Parameter Space Symmetry
Bo Zhao, Nima Dehmamy, Robin Walters +1
Neural network minima are often connected by curves along which train and test loss remain nearly constant, a phenomenon known as mode connectivity. While this property has enabled…
cs.LG2025
Improving Learning to Optimize Using Parameter Symmetries
Guy Zamir, Aryan Dokania, Bo Zhao +1
We analyze a learning-to-optimize (L2O) algorithm that exploits parameter space symmetry to enhance optimization efficiency. Prior work has shown that jointly learning symmetry tra…