benchmark dataset 1large language models 1software security 1static analysis 1vulnerability detection 1
From the 1 of 3 linked papers with an AI index.
3 papers
cs.CR2026
HoF-Bench: Rediscovering Real AI-Discovered CVEs Without Frontier Models
Petr Simecek, Elnaz Babayeva, Jiri Balhar +23
The paper presents HoF-Bench, a benchmark of 95 AI‑discovered CVEs from open‑source projects, and evaluates several LLM‑based vulnerability detectors, finding that only a minimal a…
cs.LG2025
Sleepless Nights, Sugary Days: Creating Synthetic Users with Health Conditions for Realistic Coaching Agent Interactions
Taedong Yun, Eric Yang, Mustafa Safdari +13
We present an end-to-end framework for generating synthetic users for evaluating interactive agents designed to encourage positive behavior changes, such as in health and lifestyle…
cs.CL2025
Jailbreak Distillation: Renewable Safety Benchmarking
Jingyu Zhang, Ahmed Elgohary, Xiawei Wang +5
Large language models (LLMs) are rapidly deployed in critical applications, raising urgent needs for robust safety benchmarking. We propose Jailbreak Distillation (JBDistill), a no…