Learning Semantic Parsers from Denotations with Latent Structured Alignments and Abstract Programs

Abstract

Semantic parsing aims to map natural language utterances onto machine interpretable meaning representations, aka programs whose execution against a real-world environment produces a denotation. Weakly-supervised semantic parsers are trained on utterance-denotation pairs treating programs as latent. The task is challenging due to the large search space and spuriousness of programs which may execute to the correct answer but do not generalize to unseen examples. Our goal is to instill an inductive bias in the parser to help it distinguish between spurious and correct programs. We capitalize on the intuition that correct programs would likely respect certain structural constraints were they to be aligned to the question (e.g., program fragments are unlikely to align to overlapping text spans) and propose to model alignments as structured latent variables. In order to make the latent-alignment framework tractable, we decompose the parsing task into (1) predicting a partial "abstract program" and (2) refining it while modeling structured alignments with differential dynamic programming. We obtain state-of-the-art performance on the WIKITABLEQUESTIONS and WIKISQL datasets. When compared to a standard attention baseline, we observe that the proposed structured-alignment mechanism is highly beneficial.

arXiv commentEMNLP2019

References in corpus (12)

• Sequence to Sequence Learning with Neural Networks
• Learning to Map Sentences to Logical Form: Structured Classification with Probabilistic Categorial Grammars
• Seq2SQL: Generating Structured Queries from Natural Language using Reinforcement Learning
• SQLNet: Generating Structured Queries From Natural Language Without Reinforcement Learning
• Improving Text-to-SQL Evaluation Methodology
• Learning to Transduce with Unbounded Memory
• Structured Attention Networks
• Memory Augmented Policy Optimization for Program Synthesis and Semantic Parsing
• Learning to Generalize from Sparse and Underspecified Rewards
• IncSQL: Training Incremental Text-to-SQL Parsers with Non-Deterministic Oracles
• Learning a Natural Language Interface with Neural Programmer
• Learning to Infer Program Sketches

Cited by in corpus (2)

• SeqGenSQL -- A Robust Sequence Generation Model for Structured Query Language
• A Mutual Information Maximization Approach for the Spurious Solution Problem in Weakly Supervised Question Answering