GP: Context-free Grammar Pre-training for Text-to-SQL Parsers
arXiv:2101.09901
Abstract
A new method for Text-to-SQL parsing, Grammar Pre-training (GP), is proposed to decode deep relations between question and database. Firstly, to better utilize the information of databases, a random value is added behind a question word which is recognized as a column, and the new sentence serves as the model input. Secondly, initialization of vectors for decoder part is optimized, with reference to the former encoding so that question information can be concerned. Finally, a new approach called flooding level is adopted to get the non-zero training loss which can generalize better results. By encoding the sentence with GRAPPA and RAT-SQL model, we achieve better performance on spider, a cross-DB Text-to-SQL dataset (72.8 dev, 69.8 test). Experiments show that our method is easier to converge during training and has excellent robustness.
References in corpus (6)
- Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
- mixup: Beyond Empirical Risk Minimization
- Seq2SQL: Generating Structured Queries from Natural Language using Reinforcement Learning
- GraPPa: Grammar-Augmented Pre-Training for Table Semantic Parsing
- Editing-Based SQL Query Generation for Cross-Domain Context-Dependent Questions
- Bridging Textual and Tabular Data for Cross-Domain Text-to-SQL Semantic Parsing