Probabilistic symmetries and invariant neural networks

Benjamin Bloem-Reddy, Yee Whye Teh

Treating neural network inputs and outputs as random variables, we characterize the structure of neural networks that can be used to model data that are invariant or equivariant un…