Generalization in Supervised Learning Through Riemannian Contraction

Leo Kozachkov, Patrick M. Wensing, Jean-Jacques Slotine

We prove that Riemannian contraction in a supervised learning setting implies generalization. Specifically, we show that if an optimizer is contracting in some Riemannian metric wi…