Expanding LLM Reasoning

Rian Atri, Evan Luo

Extra inference compute is usually spent on sampling more reasoning chains. We study where inside an existing chain an additional continuation should begin. We define expansion uti…