Robust Search with Uncertainty-Aware Value Models for Language Model Reasoning

Fei Yu, Yingru Li, Benyou Wang

Value model guided search is effective in steering LLM generation but suffers from a lack of robustness. This is due to verifier failure: imperfect VMs mistakenly prune valid reaso…