Automated test generation to evaluate tool-augmented LLMs as conversational AI agents

Samuel Arcadinho, David Aparicio, Mariana Almeida

Tool-augmented LLMs are a promising approach to create AI agents that can have realistic conversations, follow procedures, and call appropriate functions. However, evaluating them…