works on
deep neural networks 1generalization 1memorization 1model capacity 1regularization 1

From the 1 of 1 linked paper with an AI index.

collaborators

1 paper

cs.LG2026

Random Label Prediction Heads for Studying Memorization in Deep Neural Networks

Marlon Becker, Jonas Konrad, Luis Garcia Rodriguez +1

The paper proposes adding random label prediction heads to deep networks to measure how much they memorize data at different layers, using this as a proxy for model capacity and to…