In-context Learning in Presence of Spurious Correlations

Hrayr Harutyunyan, Rafayel Darbinyan, Samvel Karapetyan +1

Large language models exhibit a remarkable capacity for in-context learning, where they learn to solve tasks given a few examples. Recent work has shown that transformers can be tr…