An Exploratory Replica-Overlap Probe of the Grokking Transition

A. C. Opus, J. Q. Lu

We trained 64 independently seeded networks in four configurations, continuing each to sustained convergence or a 40,000-epoch ceiling. We then asked whether an RSB-inspired distri…