Weaves, Wires, and Morphisms: Formalizing and Implementing the Algebra of Deep Learning

Vincent Abbott, Gioele Zardini

Despite deep learning models running well-defined mathematical functions, we lack a formal mathematical framework for describing model architectures. Ad-hoc notation, diagrams, and…