Fisher information and the geometry of memorization in neural networks

Daniel T. Bernstein, Chase Goddard, Luca Di Carlo +2

A fruitful approach towards understanding generalization in machine learning involves characterizing how models separate generalizable structure from idiosyncratic or even corrupte…