Can Past Experience Accelerate LLM Reasoning?

Bo Pan, Liang Zhao

Allocating more compute to large language models (LLMs) reasoning has generally been demonstrated to improve their effectiveness, but also results in increased inference time. In c…