How Much Can Language Models Gain from Test-Time Computation?

Bangji Yang, Jingyuan Li, Jiajun Fan +9

How much can test-time computation improve a language model, and at what cost? Test-time scaling is widely proposed as a substitute for larger models, but existing comparisons most…