Showing cs.AIShow all
2 papers · 1 filter
cs.AI2026
ScopeBench: Do Agents Preserve Engagement Boundaries Under Goal Pressure?
Shane Caldwell, Max Harley, Ads Dawson +3
Agents are increasingly deployed with real autonomy in web application and network penetration testing, where a single out-of-scope action can breach a client's engagement boundary…
cs.AI2025
PentestJudge: Judging Agent Behavior Against Operational Requirements
Shane Caldwell, Max Harley, Michael Kouremetis +2
We introduce PentestJudge, a system for evaluating the operations of penetration testing agents. PentestJudge is a large language model (LLM)-as-judge with access to tools that all…