When Do Concepts Become Functionally Sufficient During Language-Model Training?

Raphael Bernas, Paul G. Chevalier, Fanny Jourdan +1

Understanding a model and its learning mechanisms in depth requires identifying when its internal structures become useful, rather than simply looking at the final state. We study…