Understanding Memorization from the Perspective of Optimization via Efficient Influence Estimation

Futong Liu, Tao Lin, Martin Jaggi

Over-parameterized deep neural networks are able to achieve excellent training accuracy while maintaining a small generalization error. It has also been found that they are able to…