Did the LLM Answer the Question? A Semantic Reconstruction Game for Jailbreak Evaluation

Liam Davis, Romain Emil-Popescu, Suman Jana

Jailbreak attacks against large language models (LLMs) are evaluated using attack success rate (ASR), which depends on correctly identifying responses that fulfill prohibited reque…