3 papers
cs.LG2026
Teacher Geometry Shapes Learnability in Teacher-Student Networks
Kai J. Sandbrink, Flavio Martinelli, Alexander van Meegen +2
Teacher-student systems, in which a teacher neural network generates training labels so that a student neural network can learn to implement the same function, are widely used as a…
cs.LG2025
Flat Channels to Infinity in Neural Loss Landscapes
Flavio Martinelli, Alexander Van Meegen, Berfin Şimşek +2
The loss landscapes of neural networks contain minima and saddle points that may be connected in flat regions or appear in isolation. We identify and characterize a special structu…
cs.LG2024
Coding schemes in neural networks learning classification tasks
Alexander van Meegen, Haim Sompolinsky
Neural networks posses the crucial ability to generate meaningful representations of task-dependent features. Indeed, with appropriate scaling, supervised learning in neural networ…