What Do Safety-Aligned LLMs Learn From Mixed Compliance Demonstrations?

Sihui Dai, Mann Patel

Prior work has shown that in-context demonstrations can jailbreak language models, but it remains unclear how models interpret different types of compliance demonstrations. We stud…