Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
Did the LLM Answer the Question? A Semantic Reconstruction Game for Jailbreak Evaluation
Liam Davis, Romain Emil-Popescu, Suman Jana
Jailbreak attacks against large language models (LLMs) are evaluated using attack success rate (ASR), which depends on correctly identifying responses that fulfill prohibited reque…
cs.LG2023
Beyond Accuracy: Evaluating Self-Consistency of Code Large Language Models with IdentityChain
Marcus J. Min, Yangruibo Ding, Luca Buratti +4
Code Large Language Models (Code LLMs) are being increasingly employed in real-life applications, so evaluating them is critical. While the conventional accuracy evaluates the perf…