Unfair and Unsafe: Everyday Bias Triggers Emergent Misalignment

Alex Martí Guiu, Nicolas Zumarraga, Kevin O'Sullivan +2

Emergent misalignment (EM) occurs when fine-tuning a language model to a narrow task makes it misaligned on unrelated ones. Because organizations now routinely fine-tune models on…