Learning an Executable Neural Semantic Parser

Abstract

This paper describes a neural semantic parser that maps natural language utterances onto logical forms which can be executed against a task-specific environment, such as a knowledge base or a database, to produce a response. The parser generates tree-structured logical forms with a transition-based approach which combines a generic tree-generation algorithm with domain-general operations defined by the logical language. The generation process is modeled by structured recurrent neural networks, which provide a rich encoding of the sentential context and generation history for making predictions. To tackle mismatches between natural language and logical form tokens, various attention mechanisms are explored. Finally, we consider different training settings for the neural semantic parser, including a fully supervised training where annotated logical forms are given, weakly-supervised training where denotations are provided, and distant supervision where only unlabeled sentences and a knowledge base are available. Experiments across a wide range of datasets demonstrate the effectiveness of our parser.

arXiv commentIn Journal of Computational Linguistics

References in corpus (18)

• Sequence to Sequence Learning with Neural Networks
• Learning to Map Sentences to Logical Form: Structured Classification with Probabilistic Categorial Grammars
• Seq2SQL: Generating Structured Queries from Natural Language using Reinforcement Learning
• Transition-Based Dependency Parsing with Stack Long Short-Term Memory
• Neural Programmer-Interpreters
• Long Short-Term Memory-Networks for Machine Reading
• Semantically Conditioned LSTM-based Natural Language Generation for Spoken Dialogue Systems
• Lambda Dependency-Based Compositional Semantics
• Question Answering with Subgraph Embeddings
• Language to Logical Form with Neural Attention
• Making Neural Programming Architectures Generalize via Recursion
• A Joint Model of Language and Perception for Grounded Attribute Learning
• Learning Dependency-Based Compositional Semantics
• Universal Semantic Parsing
• Learning to Paraphrase for Question Answering
• Learning Structured Natural Language Representations for Semantic Parsing
• Transfer Learning for Neural Semantic Parsing
• A Generative Parser with a Discriminative Recognition Algorithm