Risk-Aware Adaptive Evaluation: Finding High-Impact Failures Under Limited Budgets

Priyanath Maji, Spandan Ghose Chowdhury

Evaluating interactive agents is expensive. Agent behavior is stochastic, so reliability must be measured over repeated trials, but failures are rare and differ widely in how much…