Privacy Without Regret: Differentially Private Inference-Time Alignment

Ishi Jain, Nandini Bhattad, Sayak Ray Chowdhury

Best-of-N (BoN) sampling is the simplest and most widely deployed inference-time alignment strategy, but it suffers from two distinct problems: reward hacking, in which the selecte…