2 papers
stat.ML2025
Analyzing the Role of Permutation Invariance in Linear Mode Connectivity
Keyao Zhan, Puheng Li, Lei Wu
It was empirically observed in Entezari et al. (2021) that when accounting for the permutation invariance of neural networks, there is likely no loss barrier along the linear inter…
cs.LG2024
Exploring Neural Network Landscapes: Star-Shaped and Geodesic Connectivity
Zhanran Lin, Puheng Li, Lei Wu
One of the most intriguing findings in the structure of neural network landscape is the phenomenon of mode connectivity: For two typical global minima, there exists a path connecti…