On the Dynamics & Transferability of Latent Generalization during Memorization

Simran Ketha, Venkatakrishnan Ramaswamy

Deep networks have been known to have extraordinary generalization abilities, via mechanisms that aren't yet well understood. It is also known that upon shuffling labels in the tra…