5 papers
SpotIt+: Verification-based Text-to-SQL Evaluation with Database Constraints
Andrew Tremante, Yang He, Rocky Klopfenstein +3
We present SpotIt+, an open-source tool for evaluating Text-to-SQL systems via bounded equivalence verification. Given a generated SQL query and the ground truth, SpotIt+ actively…
FlexSQL: Flexible Exploration and Execution Make Better Text-to-SQL Agents
Quang Hieu Pham, Yang He, Ping Nie +5
Text-to-SQL over large analytical databases requires navigating complex schemas, resolving ambiguous queries, and grounding decisions in actual data. Most current systems follow a…
SpotIt: Evaluating Text-to-SQL Evaluation with Formal Verification
Rocky Klopfenstein, Yang He, Andrew Tremante +3
Community-driven Text-to-SQL evaluation platforms play a pivotal role in tracking the state of the art of Text-to-SQL performance. The reliability of the evaluation process is crit…
Synthesizing Optimal Object Selection Predicates for Image Editing using Lattices
Yang He, Xiaoyu Liu, Yuepeng Wang
Image editing is a common task across a wide range of domains, from personal use to professional applications. Despite advances in computer vision, current tools still demand signi…
Synthesizing Document Database Queries using Collection Abstractions
Qikang Liu, Yang He, Yanwen Cai +2
Document databases are increasingly popular in various applications, but their queries are challenging to write due to the flexible and complex data model underlying document datab…