Simplifying Neural Networks During Training

Lorenzo Sciandra, Samuele Fonio, Roberto Esposito

Understanding and exploiting the training dynamics of overparameterized deep neural networks remains a central challenge in modern machine learning. Recent evidence on Neural Colla…