Showing cs.AIShow all
2 papers · 1 filter
cs.AI2026
Lightweight, Rubric-Guided Trajectory Evaluation for Production AI Agents
Linh-An Phan, MingXue Wang, Guangyu Wu +3
Trajectory evaluation is essential for improving the reliability of LLM-based agents, but production use makes it expensive to run repeatedly. Modern agents generate long traces co…
cs.AI2024
BIS: NL2SQL Service Evaluation Benchmark for Business Intelligence Scenarios
Bora Caglayan, Mingxue Wang, John D. Kelleher +4
NL2SQL (Natural Language to Structured Query Language) transformation has seen wide adoption in Business Intelligence (BI) applications in recent years. However, existing NL2SQL be…