Mitigating Many-Shot Jailbreaking

Christopher M. Ackerman, Nina Panickssery

Many-shot jailbreaking (MSJ) is an adversarial technique that exploits the long context windows of modern LLMs to circumvent model safety training by including in the prompt many e…