11 citations · 20 across the 4 of their papers we have counts for
4 papers
Evaluating the Data Model Robustness of Text-to-SQL Systems Based on Real User Queries
Jonathan Fürst, Catherine Kosten, Farhad Nooralahzadeh +2
Text-to-SQL systems (also known as NL-to-SQL systems) have become an increasingly popular solution for bridging the gap between user capabilities and SQL-based data access. These s…
Spider4SPARQL: A Complex Benchmark for Evaluating Knowledge Graph Question Answering Systems
Catherine Kosten, Philippe Cudré-Mauroux, Kurt Stockinger
With the recent spike in the number and availability of Large Language Models (LLMs), it has become increasingly important to provide large and realistic benchmarks for evaluating…
ScienceBenchmark: A Complex Real-World Benchmark for Evaluating Natural Language to SQL Systems
Yi Zhang, Jan Deriu, George Katsogiannis-Meimarakis +3
Natural Language to SQL systems (NL-to-SQL) have recently shown a significant increase in accuracy for natural language to SQL query translation. This improvement is due to the eme…
INODE: Building an End-to-End Data Exploration System in Practice [Extended Vision]
Sihem Amer-Yahia, Georgia Koutrika, Frederic Bastian +25
A full-fledged data exploration system must combine different access modalities with a powerful concept of guiding the user in the exploration process, by being reactive and antici…