Photon: A Robust Cross-Domain Text-to-SQL System
arXiv:2007.15280
Abstract
Natural language interfaces to databases (NLIDB) democratize end user access to relational data. Due to fundamental differences between natural language communication and programming, it is common for end users to issue questions that are ambiguous to the system or fall outside the semantic scope of its underlying query language. We present Photon, a robust, modular, cross-domain NLIDB that can flag natural language input to which a SQL mapping cannot be immediately determined. Photon consists of a strong neural semantic parser (63.2\% structure accuracy on the Spider dev benchmark), a human-in-the-loop question corrector, a SQL executor and a response generator. The question corrector is a discriminative neural sequence editor which detects confusion span(s) in the input question and suggests rephrasing until a translatable input is given by the user or a maximum number of iterations are conducted. Experiments on simulated data show that the proposed method effectively improves the robustness of text-to-SQL system against untranslatable user input. The live demo of our system is available at http://naturalsql.com.
ACL 2020 system demonstration paper extended . The first two authors contributed equally to this work
References in corpus (9)
- Sequence to Sequence Learning with Neural Networks
- SQuAD: 100,000+ Questions for Machine Comprehension of Text
- Learning to Map Sentences to Logical Form: Structured Classification with Probabilistic Categorial Grammars
- Seq2SQL: Generating Structured Queries from Natural Language using Reinforcement Learning
- Improving Text-to-SQL Evaluation Methodology
- A Comprehensive Exploration on WikiSQL with Table-Aware Word Contextualization
- Editing-Based SQL Query Generation for Cross-Domain Context-Dependent Questions
- Grammar-based Neural Text-to-SQL Generation
- Bertrand-DR: Improving Text-to-SQL using a Discriminative Re-ranker