Sample Where You Struggle: Sharpening Base Model Reasoning via Entropy-Guided Power Sampling

Hong Guo, Nianhui Guo, Christoph Meinel +1

Sampling from the sequence-level power distribution $p^{\alpha }$ elicits RL-level reasoning from base language models without any parameter updates, but the standard Metropolis--Hastings…