Evaluating Open-Weight E-Commerce Agents with Environment-Grounded Verification

Nimit Shah, Haitz Sáez de Ocáriz Borde

A shopping conversation has many routes to the same cart, and a task-success rate reduces all of them to one score. We build a deterministic and reproducible e-commerce environment…