Knowing When to Quit: A Principled Framework for Dynamic Abstention in LLM Reasoning

Hen Davidov, Nachshon Cohen, Oren Kalinsky +4

LLMs utilizing chain-of-thought reasoning often waste substantial compute by producing long, incorrect responses. Abstention can mitigate this by withholding outputs unlikely to be…