Towards Spec Learning: Inference-Time Alignment from Preference Pairs

Dhriti Krishnan, Tejas Goyal, Jaromir Savelka

Steering a large language model (LLM) toward a desired behavior typically relies on an iterative process of hand-crafting a prompt based on a careful inspection of the model's resp…