HindSearch: Trajectory-Level Hindsight Critique for Search-Augmented Reinforcement Learning

Haowei Liu, Jiamian Wang, Hsin-Tai Wu +2

Search-augmented LM agents are typically trained with a binary exact-match reward, which throws away most of what a failed trajectory tells us about why it failed. We introduce Hin…