PENCIL: Long Thoughts with Short Memory

Chenxiao Yang, Nathan Srebro, David McAllester +1

While state-of-the-art LLMs have demonstrated great promise of using long Chains-of-Thought (CoT) to boost reasoning, scaling it up to more challenging problems at test-time is fun…