2 papers
cs.DB2026
SpotIt+: Verification-based Text-to-SQL Evaluation with Database Constraints
Andrew Tremante, Yang He, Rocky Klopfenstein +3
We present SpotIt+, an open-source tool for evaluating Text-to-SQL systems via bounded equivalence verification. Given a generated SQL query and the ground truth, SpotIt+ actively…
cs.DB2026
SpotIt: Evaluating Text-to-SQL Evaluation with Formal Verification
Rocky Klopfenstein, Yang He, Andrew Tremante +3
Community-driven Text-to-SQL evaluation platforms play a pivotal role in tracking the state of the art of Text-to-SQL performance. The reliability of the evaluation process is crit…