Offline Preference-Based Trajectory Evaluation

Fernando Diaz

Offline evaluation of agentic systems often collapses trajectories to terminal success, discarding information about partial progress and inducing widespread ties, creating substan…