The dynamic interplay between in-context and in-weight learning in humans and neural networks

Jacob Russin, Ellie Pavlick, Michael J. Frank

Human learning embodies a striking duality: sometimes, we appear capable of following logical, compositional rules and benefit from structured curricula (e.g., in formal education)…