DeepLogic: Towards End-to-End Differentiable Logical Reasoning
arXiv:1805.07433
Abstract
Combining machine learning with logic-based expert systems in order to get the best of both worlds are becoming increasingly popular. However, to what extent machine learning can already learn to reason over rule-based knowledge is still an open problem. In this paper, we explore how symbolic logic, defined as logic programs at a character level, is learned to be represented in a high-dimensional vector space using RNN-based iterative neural networks to perform reasoning. We create a new dataset that defines 12 classes of logic programs exemplifying increased level of complexity of logical reasoning and train the networks in an end-to-end fashion to learn whether a logic program entails a given query. We analyse how learning the inference algorithm gives rise to representations of atoms, literals and rules within logic programs and evaluate against increasing lengths of predicate and constant symbols as well as increasing steps of multi-hop reasoning.
Camera-ready AAAI-MAKE19
References in corpus (10)
- Adam: A Method for Stochastic Optimization
- On the Properties of Neural Machine Translation: Encoder-Decoder Approaches
- Dynamic Memory Networks for Visual and Textual Question Answering
- A simple neural network module for relational reasoning
- Neural-Symbolic Learning and Reasoning: A Survey and Interpretation
- Logic Tensor Networks: Deep Learning and Logical Reasoning from Data and Knowledge
- Compositional Attention Networks for Machine Reasoning
- TensorLog: A Differentiable Deductive Database
- Neural Symbolic Machines: Learning Semantic Parsers on Freebase with Weak Supervision
- Lifted Relational Neural Networks