From the 1 of 3 linked papers with an AI index.
3 papers
cs.LG2026
Random Label Prediction Heads for Studying Memorization in Deep Neural Networks
Marlon Becker, Jonas Konrad, Luis Garcia Rodriguez +1
The paper proposes adding random label prediction heads to deep networks to measure how much they memorize data at different layers, using this as a proxy for model capacity and to…
cs.LG2025
Momentum-SAM: Sharpness Aware Minimization without Computational Overhead
Marlon Becker, Frederick Altrock, Benjamin Risse
The recently proposed optimization algorithm for deep neural networks Sharpness Aware Minimization (SAM) suggests perturbing parameters before gradient calculation by a gradient as…
cs.LG2024
Learned Random Label Predictions as a Neural Network Complexity Metric
Marlon Becker, Benjamin Risse
We empirically investigate the impact of learning randomly generated labels in parallel to class labels in supervised learning on memorization, model complexity, and generalization…