R. Samworth

activity

20242026

collaborators

Showing stat.MLShow all

2 papers · 1 filter

stat.ML2026

Efficient and Minimax Optimal In-context Nonparametric Regression with Transformers

Michelle Ching, Ioana Popescu, Nico Smith +3

We study in-context learning for nonparametric regression with $I^\pm$ -HÃ¶lder smooth regression functions, for some $I^\pm > 0$ . We prove that, with $n$ in-context examples and $d$ -dimens…

stat.ML2026

Optimal In-context Adaptivity and Distributional Robustness of Transformers

Tianyi Ma, Tengyao Wang, Richard J. Samworth

We study in-context learning problems where a Transformer is pretrained on tasks drawn from a mixture distribution $I ¨ = \sum_{I^\pm \in A} I^»_{I^} \pm I ¨ _{I^} \pm$ , called the pretraining…