3 citations · 5 across the 5 of their papers we have counts for
5 papers
FlyCatcher: Neural Inference of Runtime Checkers from Tests
Beatriz Souza, Chang Lou, Suman Nath +1
Complex software systems often suffer from silent failures, i.e., violations of the intended semantics that do not cause explicit errors. A promising approach to detect such errors…
AgentRx: Diagnosing AI Agent Failures from Execution Trajectories
Shraddha Barke, Arnav Goyal, Alind Khare +3
AI agents often fail in ways that are difficult to localize because executions are probabilistic, long-horizon, multi-agent, and mediated by noisy tool outputs. We address this gap…
Generative Caching for Structurally Similar Prompts and Responses
Sarthak Chakraborty, Suman Nath, Xuchao Zhang +2
Large Language Models (LLMs) are increasingly being used to plan, reason, and execute tasks across diverse scenarios. In use cases like repeatable workflows and agentic settings, p…
WAREX: Web Agent Reliability Evaluation on Existing Benchmarks
Su Kara, Fazle Faisal, Suman Nath
Recent advances in browser-based LLM agents have shown promise for automating tasks ranging from simple form filling to hotel booking or online shopping. Current benchmarks measure…
Building AI Agents for Autonomous Clouds: Challenges and Design Principles
Manish Shetty, Yinfang Chen, Gagan Somashekar +10
The rapid growth in the use of Large Language Models (LLMs) and AI Agents as part of software development and deployment is revolutionizing the information technology landscape. Wh…