Understanding the Benefits of Scaffolds through Computational Separations

Jingchu Gai, Adam Block, Andrej Risteski

Inference-time harnesses, i.e., external procedures that call a model many times and keep state across calls, can substantially improve model capabilities. In this paper, we invest…