From the 1 of 9 linked papers with an AI index.
6 papers · 1 filter
Who Grades the Grader? Co-Evolving Evaluation Metrics and Skills for Self-Improving LLM Agents
Xing Zhang, Guanghui Wang, Yanwei Cui +4
The paper introduces a framework that co‑evolves evaluation metrics and the skills of LLM agents using an evolutionary loop guided by anchored reference sets, enabling transparent…
The Blind Curator: How a Biased Judge Silently Disables Skill Retirement in Self-Evolving Agents
Xing Zhang, Yanwei Cui, Guanghui Wang +4
A self-evolving agent retires its bad skills by watching them fail, so what happens when the judge cannot see the failures? Skill retirement is the structural constraint that keeps…
Experience Compression Spectrum: Unifying Memory, Skills, and Rules in LLM Agents
Xing Zhang, Guanghui Wang, Yanwei Cui +4
As LLM agents scale to long-horizon, multi-session deployments, efficiently managing accumulated experience becomes a critical bottleneck. Agent memory systems and agent skill disc…
Guardrails Beat Guidance: A Large-Scale Study of Rules, Skills, and Persistent Configuration for Coding Agents
Xing Zhang, Guanghui Wang, Yanwei Cui +4
Random rules improve a coding agent's task performance as much as expert-curated ones (both pp on a discriminative subset of SWE-bench Verified), and in our data every indiv…
Prompt Optimization Is a Coin Flip: Diagnosing When It Helps in Compound AI Systems
Xing Zhang, Guanghui Wang, Yanwei Cui +4
Prompt optimization in compound AI systems is statistically indistinguishable from a coin flip: across 72 optimization runs on Claude Haiku 4.5 (6 methods 4 tasks …
Verified Multi-Agent Orchestration: A Plan-Execute-Verify-Replan Framework for Complex Query Resolution
Xing Zhang, Yanwei Cui, Guanghui Wang +7
We present Verified Multi-Agent Orchestration (VMAO), a framework that coordinates specialized LLM-based agents through a verification-driven iterative loop. Given a complex query,…