Bigger Is Safer: Provable Robustness in In-Context Learning Scales with Capacity

Di Zhang, Ningxu Zhang, Zimeng Liu

In-context learning (ICL) allows large language models to adapt to new tasks from a few examples without updating their parameters. Existing theories explain ICL by assuming the te…