most citedJailbreakBench: An Open Robustness Benchmark for Jailbreaking Large Language Models

12 citations · 25 across the 5 of their papers we have counts for

collaborators

5 papers

cs.CR2024★ 1 cited

Watermarking Language Models with Error Correcting Codes

Patrick Chao, Yan Sun, Edgar Dobriban +1

Recent progress in large language models enables the creation of realistic machine-generated content. Watermarking is a promising approach to distinguish machine-generated text fro…

cs.CR2024★ 12 cited

JailbreakBench: An Open Robustness Benchmark for Jailbreaking Large Language Models

Patrick Chao, Edoardo Debenedetti, Alexander Robey +9

Jailbreak attacks cause large language models (LLMs) to generate harmful, unethical, or otherwise objectionable content. Evaluating these attacks presents a number of challenges, w…

cs.AI2024★ 11 cited

A Safe Harbor for AI Evaluation and Red Teaming

Shayne Longpre, Sayash Kapoor, Kevin Klyman +20

Independent evaluation and red teaming are critical for identifying the risks posed by generative AI systems. However, the terms of service and enforcement strategies used by promi…

cs.CL2024

Assessing biomedical knowledge robustness in large language models by query-efficient sampling attacks

R. Patrick Xian, Alex J. Lee, Satvik Lolla +4

The increasing depth of parametric domain knowledge in large language models (LLMs) is fueling their rapid deployment in real-world applications. Understanding model vulnerabilitie…

math.MG2016★ 1 cited

Different definitions of conic sections in hyperbolic geometry

Patrick Chao, Jonathan Rosenberg

In classical Euclidean geometry, there are several equivalent definitions of conic sections. We show that in the hyperbolic plane, the analogues of these same definitions still mak…