In-Context Learning Operates as Concept Subspace Learning

Wei Tang, Xinyan Jiang, Fakhri Karray +1

Regression and Bayesian accounts of in-context learning (ICL) explain how demonstrations can induce predictors, while mechanistic analyses often identify compact activation directi…