Aligned Data Can Induce Misalignment via Context Confusion

Yavuz Bakman, Duygu Nur Yaldiz, Baris Askin +4

Large language models (LLMs) are frequently updated for various use cases, where filtering out misaligned training samples is a common practice for preventing post-update misalignm…