10 citations · 32 across the 22 of their papers we have counts for
3 papers · 1 filter
Coverage Aware Active Evaluation for Failure Discovery with Paired Systems
Anjali Parashar, Rachel Luo, Apoorva Sharma +6
Autonomous systems can fail in rare and heterogeneous ways, making real-world failure discovery difficult under limited testing budgets. Although cheaper proxies such as simulators…
Litmus: Zero-Label, Code-Driven Metric Specification for Evaluating AI Systems
Prajjwal Gupta, Prasang Gupta, Vishal Bhutani +4
As agentic LLM systems move from prototypes to deployment, evaluating them has become more important and more difficult. Evaluation goals are often left implicit. Without a clear a…
Robust and Adaptive Planning under Model Uncertainty
Apoorva Sharma, James Harrison, Matthew Tsao +1
Planning under model uncertainty is a fundamental problem across many applications of decision making and learning. In this paper, we propose the Robust Adaptive Monte Carlo Planni…