Computational principles of intelligence: learning and reasoning with neural networks

Abstract

Despite significant achievements and current interest in machine learning and artificial intelligence, the quest for a theory of intelligence, allowing general and efficient problem solving, has done little progress. This work tries to contribute in this direction by proposing a novel framework of intelligence based on three principles. First, the generative and mirroring nature of learned representations of inputs. Second, a grounded, intrinsically motivated and iterative process for learning, problem solving and imagination. Third, an ad hoc tuning of the reasoning mechanism over causal compositional representations using inhibition rules. Together, those principles create a systems approach offering interpretability, continuous learning, common sense and more. This framework is being developed from the following perspectives: as a general problem solving method, as a human oriented tool and finally, as model of information processing in the brain.

References in corpus (19)

• Overcoming catastrophic forgetting in neural networks
• Neural Discrete Representation Learning
• Understanding deep learning requires rethinking generalization
• Explainable Artificial Intelligence: Understanding, Visualizing and Interpreting Deep Learning Models
• Deep Learning: A Critical Appraisal
• One-shot Learning with Memory-Augmented Neural Networks
• One-Shot Visual Imitation Learning via Meta-Learning
• Distilling a Neural Network Into a Soft Decision Tree
• Data-Efficient Hierarchical Reinforcement Learning
• Regularization for Deep Learning: A Taxonomy
• Why do deep convolutional networks generalize so poorly to small image transformations?
• Adversarial Examples that Fool both Computer Vision and Time-Limited Humans
• Schema Networks: Zero-shot Transfer with a Generative Causal Model of Intuitive Physics
• Measuring abstract reasoning in neural networks
• Do CIFAR-10 Classifiers Generalize to CIFAR-10?
• Scalable agent alignment via reward modeling: a research direction
• Learning Visual Predictive Models of Physics for Playing Billiards
• Visual Interpretability for Deep Learning: a Survey
• Action-Driven Object Detection with Top-Down Visual Attentions