AlcaTRAz - Anchored Tree-Rule Defense Against Jailbreaks

Jakub Reš, Petr Kaška, Martin Perešíni +2

Large language models (LLMs) are vulnerable to jailbreak attacks that bypass safety alignment through carefully crafted prompts. Many existing defenses require access to model weig…