Implicit Bias and Invariance: How Hopfield Networks Efficiently Learn Graph Orbits

Michael Murray, Tenzin Chan, Kedar Karhadker +1

Many learning problems are organized by group symmetries. While invariance is often imposed through architectures or group averaging, we ask when it can emerge from training on a f…