3 papers
cs.AI2026
OSGuard: A Benchmark for Safety in Computer-Use Agents
Mina Mohammadmirzaei, Jeffrey Flanigan
Computer-use agents can complete benign user instructions while violating important constraints of the user's environment. We introduce OSGuard, a dual-granularity benchmark suite…
cs.CL2026
Right or Wrong, Models Comply: Directional Blindness in LLM Moral Judgment
Jihye Kim, Jeffrey Flanigan
As language models take integrated roles across many domains, the response of LLMs to user pushback becomes a critical alignment property. Yet many existing evaluations treat compl…
cs.CL2026
Dialogue SWE-Bench: A Benchmark for Dialogue-Driven Coding Agents
Brendan King, Jeffrey Flanigan
AI coding agents have rapidly transformed software engineering, powering widely used interactive coding assistants. Despite their interactive real-world use, existing benchmarks ev…