A Matter of TASTE: Improving Coverage and Difficulty of Agent Benchmarks

Tomer Keren, Nitay Calderon, Asaf Yehudai +3

As agent capabilities advance, existing benchmarks, such as $\ddot{I}{„}^2$-Bench, are becoming increasingly saturated. Yet constructing new benchmark tasks remains complex, costly, and lab…