Agents Trust Tools Too Much: Measuring Reliance on Unreliable Tools

Hoyeol Yang, Woojung Song, Taewon Kim +3

Existing evaluations of tool-using agents primarily measure whether an agent can successfully complete diverse tasks with tools. These evaluations generally assume that tools retur…