Elicitation without Backpropagation: Steering Model Behavior by Optimizing the Latent Posterior

Garrett Baker, Vinayak Pathak, Daniel Murfet +1

In the \emph{latent posterior model} of transformer behavior, the next-token distribution arises from a posterior over latent predictive models conditioned on the context, mixed to…