Showing cs.AIShow all
2 papers · 1 filter
cs.AI2026
SRE-Marathon: A Continuous, Change-Driven Benchmark for Autonomous Site Reliability Agents
Yifang Tian, Yingjian Bai, Yifeng He +4
Benchmarks for site reliability engineering (SRE) agents are typically episodic: one fault is injected, the agent receives an incident task, and its response is scored. Production…
cs.AI2026
When Agentic Executions Fail: Detecting and Localizing Runtime Faults from Telemetry
Chenkai Zhang, Yiran Li, Yifang Tian +2
Reliability in LLM-based agentic systems is a property of the whole execution (its tool calls, model calls, guardrails, and inter-agent messages), not of the final answer alone, ye…