When Retrieval Metrics Mislead: Measuring Policy Signal in Long-Horizon Tool-Use Agents

Tianyu Ding, Juan Pablo De la Cruz Weinstein

Exact-match retrieval recall is often used as a proxy for whether a retriever supplies useful policy context to a downstream decision model. We test this proxy for pre-action polic…