Memorization in image classification: test set behavior and scaling laws

Jeevesh Attri, Florentin Guth

Deep neural networks are capable of both learning generalizing solutions on natural tasks and memorizing arbitrary mappings. We argue that understanding the former requires underst…