Spin glass model of in-context learning

Yuhao Li, Ruoran Bai, Haiping Huang

Large language models show a surprising in-context learning ability -- being able to use a prompt to form a prediction for a query, yet without additional training, in stark contra…