Backprop as Functor: A compositional perspective on supervised learning

Brendan Fong, David I. Spivak, Rémy Tuyéras

A supervised learning algorithm searches over a set of functions $A\to B$ parametrised by a space $P$ to find the best approximation to some ideal function $f:A\to B$. It d…