How Many Tools Should an LLM Agent See? A Chance-Corrected Answer

Vyzantinos Repantis, Ameya Gawde, Harshvardhan Singh +1

Before an LLM agent can use a tool, a retrieval system must decide which candidate tools to show to the agent. How long should that shortlist be? Show too many tools and the model…