3 papers
cs.CL2026
Linear representations in language models can change dramatically over a conversation
Andrew Kyle Lampinen, Yuxuan Li, Eghbal Hosseini +2
Language model representations often contain linear directions that correspond to high-level concepts. Here, we study the dynamics of these representations: how representations evo…
cs.CL2025
On the generalization of language models from in-context learning and finetuning: a controlled study
Andrew K. Lampinen, Arslan Chaudhry, Stephanie C. Y. Chan +7
Large language models exhibit exciting capabilities, yet can show surprisingly narrow generalization from finetuning. E.g. they can fail to generalize to simple reversals of relati…
cs.CL2025
The broader spectrum of in-context learning
Andrew Kyle Lampinen, Stephanie C. Y. Chan, Aaditya K. Singh +1
The ability of language models to learn a task from a few examples in context has generated substantial interest. Here, we provide a perspective that situates this type of supervis…