Grounding inductive biases in natural images:invariance stems from variations in data

Diane Bouchacourt, Mark Ibrahim, Ari S. Morcos

To perform well on unseen and potentially out-of-distribution samples, it is desirable for machine learning models to have a predictable response with respect to transformations af…