4 papers
The Imperishable Record, Forgiveness, and the Future of Criminal Justice
Mark Fenwick, Paulius Jurcys, Sebastian Porsdam Mann
Digital technologies can preserve records of wrongdoing indefinitely, and AI can give those records continuing influence over a person's future. We describe this condition as the e…
Beyond Oracle Communication: Benchmarking Interactive Intent Alignment Under Miscommunication and Evolving User Intent
Zheyuan Zhang, Mengyuan Chao, Ke Xiao +5
Modern LLM agents increasingly tackle complex tasks through interactive, long-horizon exchanges with users, while existing benchmarks generally assume that users always accurately…
TraceDance: An Automated System for Building Agent Behavior Benchmarks from Real-World Agent Deployment Traces
Dehai Min, Daoan Zhang, Yiming Zeng +13
An agent can complete a task while exhibiting undesirable behavior during execution. Developers need tests for the specific behaviors encountered in deployment, beyond fixed benchm…
VideoWeaver: Evaluating and Evolving Skills for Agentic Long Video Generation
Jianhui Wei, Jie Tan, Hengchuan Zhu +7
Agentic long video generation requires planning, tool orchestration, and cross-clip coordination over a long horizon. Most existing video agents either rely on static, human-crafte…