You Can't Prefer Emotions You Don't Sample: Intensity Undershoot in DPO-Tuned LLMs

Hyunwoo Kim, Usama Khalid

Ask a language model to respond "very excitedly," and its output is typically only mildly more energetic. We quantify this effect. We condition an instruction-tuned LLM on a contin…