Recursive Language Models Generalize Out of Domain

Chenxiao Yang, Zhiyuan Li, David McAllester +1

We study when limiting what a language model can see improves learning. We compare standard CoT, the more general learner that reads the full trace, with recursive language models,…