To Intervene or Not: Guiding Inference-time Alignment with Probabilistic Model Blending

Jin Gan, Xin Li, Jun Luo

The wide deployment of LLMs has made model alignment necessary to make newly trained models safely and effectively respond to user instructions. Among different methods, inference-…