Selective Replay Enhances Learning in Online Continual Analogical Reasoning

Abstract

In continual learning, a system learns from non-stationary data streams or batches without catastrophic forgetting. While this problem has been heavily studied in supervised image classification and reinforcement learning, continual learning in neural networks designed for abstract reasoning has not yet been studied. Here, we study continual learning of analogical reasoning. Analogical reasoning tests such as Raven's Progressive Matrices (RPMs) are commonly used to measure non-verbal abstract reasoning in humans, and recently offline neural networks for the RPM problem have been proposed. In this paper, we establish experimental baselines, protocols, and forward and backward transfer metrics to evaluate continual learners on RPMs. We employ experience replay to mitigate catastrophic forgetting. Prior work using replay for image classification tasks has found that selectively choosing the samples to replay offers little, if any, benefit over random selection. In contrast, we find that selective replay can significantly outperform random selection for the RPM task.

arXiv commentTo appear in the IEEE Conference on Computer Vision and Pattern Recognition Workshop (CVPR-W) on Continual Learning in Computer Vision (CLVision) 2021

References in corpus (18)

• Distilling the Knowledge in a Neural Network
• Overcoming catastrophic forgetting in neural networks
• A continual learning survey: Defying forgetting in classification tasks
• Riemannian Walk for Incremental Learning: Understanding Forgetting and Intransigence
• Continual Learning Through Synaptic Intelligence
• Efficient Lifelong Learning with A-GEM
• FearNet: Brain-Inspired Model for Incremental Learning
• Visual Question Answering: Datasets, Algorithms, and Future Challenges
• A Multi-World Approach to Question Answering about Real-World Scenes based on Uncertain Input
• A Comprehensive Study of Class Incremental Learning Algorithms for Visual Tasks
• Measuring Catastrophic Forgetting in Neural Networks
• Measuring abstract reasoning in neural networks
• Improving Generalization for Abstract Reasoning Tasks Using Disentangled Feature Representations
• Learning Perceptual Inference by Contrasting
• Abstract Reasoning with Distracting Features
• RODEO: Replay for Online Object Detection
• Stratified Rule-Aware Network for Abstract Visual Reasoning
• Attention on Abstract Visual Reasoning