Generalized Gradient Descent is a Hypergraph Functor

Tyler Hanks, James Fairbanks, Matthew Klawonn

Cartesian reverse derivative categories (CRDCs) provide an axiomatic generalization of the reverse derivative, which allows generalized analogues of classic optimization algorithms…