16 citations · 40 across the 12 of their papers we have counts for
4 papers · 1 filter
Spider4SPARQL: A Complex Benchmark for Evaluating Knowledge Graph Question Answering Systems
Catherine Kosten, Philippe Cudré-Mauroux, Kurt Stockinger
With the recent spike in the number and availability of Large Language Models (LLMs), it has become increasingly important to provide large and realistic benchmarks for evaluating…
Is Your Learned Query Optimizer Behaving As You Expect? A Machine Learning Perspective
Claude Lehmann, Pavel Sulimov, Kurt Stockinger
The current boom of learned query optimizers (LQO) can be explained not only by the general continuous improvement of deep learning (DL) methods but also by the straightforward for…
Data-Driven Information Extraction and Enrichment of Molecular Profiling Data for Cancer Cell Lines
Ellery Smith, Rahel Paloots, Dimitris Giagkos +2
With the proliferation of research means and computational methodologies, published biomedical literature is growing exponentially in numbers and volume. Cancer cell lines are freq…
ScienceBenchmark: A Complex Real-World Benchmark for Evaluating Natural Language to SQL Systems
Yi Zhang, Jan Deriu, George Katsogiannis-Meimarakis +3
Natural Language to SQL systems (NL-to-SQL) have recently shown a significant increase in accuracy for natural language to SQL query translation. This improvement is due to the eme…