Product Interaction: An Algebraic Formalism for Deep Learning Architectures

Haonan Dong, Chun-Wun Cheng, Angelica I. Aviles-Rivero

Modern neural architectures are largely developed as distinct empirical constructions, despite recurring principles across convolutional, attention, state-space, and equivariant mo…