Self-Consistency via Marginal Sharpening

Aleksei Arzhantsev, Otmane Sakhi, Nicolas Chopin

Inference-time sampling can elicit strong reasoning abilities from language models without additional training. Existing power-sampling methods do so by sharpening the distribution…