On the Power of (Approximate) Reward Models for Inference-Time Scaling

Youheng Zhu, Yiping Lu

Inference-time scaling has recently emerged as a powerful paradigm for improving the reasoning capability of large language models. Among various approaches, Sequential Monte Carlo…