most citedCybersecurity AI Benchmark (CAIBench): A Meta-Benchmark for Evaluating Cybersecurity AI Agents

1 citations · 1 across the 11 of their papers we have counts for

collaborators

11 papers

cs.CR2026

Synthetic APTs: the Collapse of TTP-Based Attribution

Francesco Balassone, Víctor Mayoral-Vilches, María Sanz-Gómez +8

Cyber Threat Intelligence CTI attribution relies on identifying the Tactics, Techniques, and Procedures TTPs that distinguish one threat actor from another. This approach presuppos…

cs.CR2026

Towards Cybersecurity SuperIntelligence (CSI): What's the best harness for cybersecurity?

Víctor Mayoral-Vilches, Francesco Balassone, María Sanz-Gómez +5

What is the best harness for cybersecurity AI? Cybersecurity systems are converging on a single execution scaffold per agent, an iterative shell loop driven by a Large Language Mod…

cs.CR2026

Dynamic Cyber Ranges

Víctor Mayoral-Vilches, María Sanz-Gómez, Francesco Balassone +6

As LLM-driven agents advance in cybersecurity, Jeopardy CTF benchmarks are approaching saturation and cyber ranges, the natural next evaluation frontier, offer diminishing resistan…

cs.CR2026

Cybersecurity AI: Hacking Consumer Robots in the AI Era

Víctor Mayoral-Vilches, Unai Ayucar-Carbajo, Olivier Laflamme +5

Is robot cybersecurity broken by AI? Consumer robots -- from autonomous lawnmowers to powered exoskeletons and window cleaners -- are rapidly entering homes and workplaces, yet the…

cs.CR2026

Towards Cybersecurity Superintelligence: from AI-guided humans to human-guided AI

Víctor Mayoral-Vilches, Stefan Rass, Martin Pinzger +14

Cybersecurity superintelligence -- artificial intelligence exceeding the best human capability in both speed and strategic reasoning -- represents the next frontier in security. Th…

cs.CR2026

Cybersecurity AI: A Game-Theoretic AI for Guiding Attack and Defense

Víctor Mayoral-Vilches, María Sanz-Gómez, Francesco Balassone +6

AI-driven penetration testing now executes thousands of actions per hour but still lacks the strategic intuition humans apply in competitive security. To build cybersecurity superi…

cs.CR2025

Cybersecurity AI: The World's Top AI Agent for Security Capture-the-Flag (CTF)

Víctor Mayoral-Vilches, Luis Javier Navarrete-Lozano, Francesco Balassone +4

Are Capture-the-Flag competitions obsolete? In 2025, Cybersecurity AI (CAI) systematically conquered some of the world's most prestigious hacking competitions, achieving Rank #1 at…

cs.CR2025

Cybersecurity AI in OT: Insights from an AI Top-10 Ranker in the Dragos OT CTF 2025

Víctor Mayoral-Vilches, Luis Javier Navarrete-Lozano, Francesco Balassone +3

Operational Technology (OT) cybersecurity increasingly relies on rapid response across malware analysis, network forensics, and reverse engineering disciplines. We examine the perf…

cs.CR2025★ 1 cited

Cybersecurity AI Benchmark (CAIBench): A Meta-Benchmark for Evaluating Cybersecurity AI Agents

María Sanz-Gómez, Víctor Mayoral-Vilches, Francesco Balassone +3

Cybersecurity spans multiple interconnected domains, complicating the development of meaningful, labor-relevant benchmarks. Existing benchmarks assess isolated skills rather than i…

cs.CR2025

Cybersecurity AI: Evaluating Agentic Cybersecurity in Attack/Defense CTFs

Francesco Balassone, Víctor Mayoral-Vilches, Stefan Rass +4

We empirically evaluate whether AI systems are more effective at attacking or defending in cybersecurity. Using CAI (Cybersecurity AI)'s parallel execution framework, we deployed a…

cs.CR2025

CAI: An Open, Bug Bounty-Ready Cybersecurity AI

Víctor Mayoral-Vilches, Luis Javier Navarrete-Lozano, María Sanz-Gómez +10

By 2028 most cybersecurity actions will be autonomous, with humans teleoperating. We present the first classification of autonomy levels in cybersecurity and introduce Cybersecurit…