Operationalising Multi-Dimensional Evaluation for Conversational Agents: A Scalable, Governed Pipeline with Selective Re-evaluation and Model Benchmarking

Niranjan Kumar M, Balaji Nagarajan, Karthik Nair +2

The paper introduces GenAI Evaluation, a configurable, governed pipeline that uses LLM-as-a-judge scoring to automatically evaluate retail conversational agents across multiple dim…