16 citations · 41 across the 21 of their papers we have counts for
3 papers · 1 filter
Learning Strategies to Break Judges
Guruprerana Shabadi, Aaditya Naik, Rajeev Alur +1
As AI agents surpass human performance, it becomes exceedingly hard for system designers to evaluate them directly and understand their failure modes. Consequently, agents themselv…
Detecting Safety Violations Across Many Agent Traces
Adam Stein, Davis Brown, Hamed Hassani +2
To identify safety violations, auditors often search over large sets of agent traces. This search is difficult because failures are often rare, complex, and sometimes even adversar…
Relational Programming with Foundation Models
Ziyang Li, Jiani Huang, Jason Liu +6
Foundation models have vast potential to enable diverse AI applications. The powerful yet incomplete nature of these models has spurred a wide range of mechanisms to augment them w…