Structural Abstraction as an Inductive Bias for Non-Stationary Language Model Training

Elnaz Rahmati, Nona Ghazizadeh, Zhivar Sourati +2

A foundational principle in cognitive science holds that intelligent agents do not learn by storing experiences as isolated instances, but by forming abstract schemas that capture…