Inference Time Optimization with Confidence Dynamics

Yu Wang, Minghao Liu, Jiayun Wang +3

Inference time optimization techniques, such as repeated sampling, have significantly advanced the reasoning capabilities of Large Language Models (LLMs). However, the critical rol…