From the 1 of 5 linked papers with an AI index.
5 papers
RippleBench: Capturing Ripple Effects Using Existing Knowledge Repositories
Roy Rinberg, Usha Bhalla, Igor Shilov +2
The paper presents RippleBench, a benchmark that automatically creates multiple‑choice questions about semantically related concepts using a Wikipedia‑based retrieval system, to me…
Gaze Heads: How VLMs Look at What They Describe
Rohit Gandikota, David Bau
How a vision-language model internally solves the task of describing an image is far from obvious. We find that the model develops a specific mechanism for this: a small set of att…
Agents of Chaos
Natalie Shapira, Chris Wendler, Avery Yen +35
We report an exploratory red-teaming study of autonomous language-model-powered agents deployed in a live laboratory environment with persistent memory, email accounts, Discord acc…
Model Tampering Attacks Enable More Rigorous Evaluations of LLM Capabilities
Zora Che, Stephen Casper, Robert Kirk +12
Evaluations of large language model (LLM) risks and capabilities are increasingly being incorporated into AI risk management and governance frameworks. Currently, most risk evaluat…
Jailbreak Distillation: Renewable Safety Benchmarking
Jingyu Zhang, Ahmed Elgohary, Xiawei Wang +5
Large language models (LLMs) are rapidly deployed in critical applications, raising urgent needs for robust safety benchmarking. We propose Jailbreak Distillation (JBDistill), a no…