Supervised learning pays attention

Erin Craig, Robert Tibshirani

In-context learning with attention enables large neural networks to make context-specific predictions by selectively focusing on relevant examples. Here, we adapt this idea to supe…