works on
ai agents 1ai safety 1automated auditing 1benchmark evaluation 1benchmark scaling 1evaluation 1evaluation methodology 1failure analysis 1inference compute 1large language models 1model validation 1research automation 1

From the 3 of 12 linked papers with an AI index.

most citedA Real-World Evaluation of LLM Medication Safety Reviews in NHS Primary Care

1 citations · 1 across the 10 of their papers we have counts for

collaborators
Showing cs.SEShow all

1 paper · 1 filter

cs.SE2026

Capture the Flags: Family-Based Evaluation of Agentic LLMs via Semantics-Preserving Transformations

Shahin Honarvar, Amber Gorzynski, James Lee-Jones +4

Agentic large language models (LLMs) are increasingly evaluated on cybersecurity tasks using capture-the-flag (CTF) benchmarks, yet existing pointwise benchmarks offer limited insi…