Showing cs.AIShow all
2 papers · 1 filter
cs.AI2026
OTAP: Structure-Aware Optimal Transport for Evaluating Planning and Execution in Agent Trajectories
Babak Barazandeh, Subhabrata Majumdar, George Michailidis
Large language model agents solve tasks by generating trajectories that interleave planning, tool calls, and intermediate results. Current evaluation metrics reduce such a trajecto…
cs.AI2026
Consistency as a Testable Property: Statistical Methods to Evaluate AI Agent Reliability
Harsh Raj, Niranjan Orkat, Suvrorup Mukherjee +3
This paper establishes a rigorous measurement science for AI agent reliability, providing a foundational framework for quantifying consistency under semantically preserving perturb…