Beyond Prediction: A Component-Level Study of Concept Recovery in In-Context Learning

Xufeng Liu, Fang Wan, Yi Liu

In-context learning (ICL) enables language models to make accurate predictions from demonstrations, but prediction success alone does not reveal the extent to which the underlying…