Grading the Grader: Lessons from Evaluating an Agentic Data Analysis System

Tian Zheng, Kai-Tai Hsu

Agentic data analysis systems produce rich outputs, including code, numerical results, and verbal diagnostics. This makes them more challenging to evaluate than single-turn LLM res…