Recipes for Steering and Scaling LLMs via Sampling

Jiajun He, Zongyu Guo, José Miguel Hernández-Lobato +1

Large Language Models (LLMs) are probabilistic models, typically defined by an autoregressive factorization. While recent work has begun to study richer target distributions beyond…