Paths and Ambient Spaces in Neural Loss Landscapes

Daniel Dold, Julius Kobialka, Nicolai Palm +3

Understanding the structure of neural network loss surfaces, particularly the emergence of low-loss tunnels, is critical for advancing neural network theory and practice. In this p…