Recursive Language Models

Alex L. Zhang, Tim Kraska, Omar Khattab

We study allowing large language models (LLMs) to process arbitrarily long prompts through the lens of inference-time scaling. We propose Recursive Language Models (RLMs), a genera…