4 papers · 1 filter
AutoSpec: Safety Rule Evolution for LLM Agents via Inductive Logic Programming
Pingchuan Ma, Zhaoyu Wang, Zimo Ji +5
Large language model (LLM) agents increasingly automate complex tasks by integrating language models with external tools and environments. However, their autonomy poses significant…
Coding Agents Are Guessing: Measuring Action-Boundary Violations in Underspecified DevOps Instructions
Zimo Ji, Zekai Zhang, Congying Xu +4
LLM coding agents are increasingly deployed to act autonomously on real production infrastructure. They execute shell commands, modify repositories, and call operational APIs. Howe…
Measuring the Permission Gate: A Stress-Test Evaluation of Claude Code's Auto Mode
Zimo Ji, Zongjie Li, Pingchuan Ma +3
Claude Code's auto mode is the first deployed permission system for AI coding agents, using a two-stage transcript classifier to gate dangerous tool calls. Anthropic reports a 0.4%…
SkillReducer: Optimizing LLM Agent Skills for Token Efficiency
Yudong Gao, Zongjie Li, Yuanyuan Yuan +3
LLM-based coding agents rely on \emph{skills}, pre-packaged instruction sets that extend agent capabilities, yet every token of skill content injected into the context window incur…