Exploring Neural Models for Parsing Natural Language into First-Order Logic
arXiv:2002.06544
Abstract
Semantic parsing is the task of obtaining machine-interpretable representations from natural language text. We consider one such formal representation - First-Order Logic (FOL) and explore the capability of neural models in parsing English sentences to FOL. We model FOL parsing as a sequence to sequence mapping task where given a natural language sentence, it is encoded into an intermediate representation using an LSTM followed by a decoder which sequentially generates the predicates in the corresponding FOL formula. We improve the standard encoder-decoder model by introducing a variable alignment mechanism that enables it to align variables across predicates in the predicted FOL. We further show the effectiveness of predicting the category of FOL entity - Unary, Binary, Variables and Scoped Entities, at each decoder step as an auxiliary task on improving the consistency of generated FOL. We perform rigorous evaluations and extensive ablations. We also aim to release our code as well as large scale FOL dataset along with models to aid further research in logic-based parsing and inference in NLP.
11 Pages, 2 Figures
References in corpus (17)
- Adam: A Method for Stochastic Optimization
- Sequence to Sequence Learning with Neural Networks
- Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation
- A Neural Conversational Model
- Learning to Map Sentences to Logical Form: Structured Classification with Probabilistic Categorial Grammars
- Seq2SQL: Generating Structured Queries from Natural Language using Reinforcement Learning
- A large annotated corpus for learning natural language inference
- Adversarial Examples for Evaluating Reading Comprehension Systems
- A Deep Generative Framework for Paraphrase Generation
- Lambda Dependency-Based Compositional Semantics
- Language to Logical Form with Neural Attention
- Compositional Semantic Parsing on Semi-Structured Tables
- A Syntactic Neural Model for General-Purpose Code Generation
- Acquiring Word-Meaning Mappings for Natural Language Interfaces
- Probing Neural Network Comprehension of Natural Language Arguments
- Data Recombination for Neural Semantic Parsing
- Learning Structured Natural Language Representations for Semantic Parsing