Generalization to Political Beliefs from Fine-Tuning on Sports Team Preferences

Owen Terry

Fine-tuned LLMs often exhibit unexpected behavior as a result of generalizing beyond the data they're shown. We present results in which an LLM fine-tuned to prefer either coastal…