A Matter of TASTE: Improving Coverage and Difficulty of Agent Benchmarks

Tomer Keren, Nitay Calderon, Asaf Yehudai +3

As agent capabilities advance, existing benchmarks, such as ${\tau }^2$-Bench, are becoming increasingly saturated. Yet constructing new benchmark tasks remains complex, costly, and labo…