When Does the Best Sampling Temperature Rise with the Budget? Sufficient Conditions for Pass@k

Changsu Jeong

The temperature that maximizes pass@$k$ is often low for a small sampling budget and higher for a large budget. This pattern has been reported from Codex through recent multi-sampl…