9 papers
FormStruct-Bench:A Hierarchical and Diagnostic Benchmark for Table-Form Document Structure Recognition
Lujie Ban, Jiangtao Zhu, Yuanheng Yu +2
Transforming table-form documents into machine-processable records requires recovering not only their visible content but also the multilevel structure that organizes it. However,…
CAPER: Clause-Aligned Process Supervision for Text-to-SQL
Lujie Ban, Jiasheng Shi, Jinyang Li +3
Text-to-SQL systems are typically evaluated by query-level execution correctness, but this terminal signal provides little guidance about which intermediate SQL decision caused suc…
Text2GraphQuery-Bench: A Text to Graph Query Benchmark
Songlin Lyu, Lujie Ban, Zihang Wu +14
Graph models are fundamental to data analysis in domains rich with complex relationships. Unlike SQL, which benefits from a rel- atively unified standard and widespread familiarity…
SWE-SQL: Illuminating LLM Pathways to Solve User SQL Issues in Real-World Applications
Jinyang Li, Xiaolong Li, Ge Qu +17
Resolution of complex SQL issues persists as a significant bottleneck in real-world database applications. Current Large Language Models (LLMs), while adept at text-to-SQL translat…
Revisiting Task-Oriented Dataset Search in the Era of Large Language Models: Challenges, Benchmark, and Solution
Zixin Wei, Yucan Guo, Jinyang Li +3
The search for suitable datasets is the critical "first step" in data-driven research, but it remains a great challenge. Researchers often need to search for datasets based on high…
Attribute Filtering in Approximate Nearest Neighbor Search: An In-depth Experimental Study
Mocheng Li, Xiao Yan, Baotong Lu +3
With the growing integration of structured and unstructured data, new methods have emerged for performing similarity searches on vectors while honoring structured attribute constra…