Grokking Modular Polynomials

Darshil Doshi, Tianyu He, Aritra Das +1

Neural networks readily learn a subset of the modular arithmetic tasks, while failing to generalize on the rest. This limitation remains unmoved by the choice of architecture and t…