Probing the Misaligned Thinking Process of Language Models

Kaiwen Zhou, Constantin Venhoff, Jonathan Michala +2

Large language models exhibit a growing range of misaligned behaviors such as strategic deception, sandbagging, and self-preservation. As they are increasingly deployed in high-sta…