Selective Replay Enhances Learning in Online Continual Analogical Reasoning
arXiv:2103.03987
Abstract
In continual learning, a system learns from non-stationary data streams or batches without catastrophic forgetting. While this problem has been heavily studied in supervised image classification and reinforcement learning, continual learning in neural networks designed for abstract reasoning has not yet been studied. Here, we study continual learning of analogical reasoning. Analogical reasoning tests such as Raven's Progressive Matrices (RPMs) are commonly used to measure non-verbal abstract reasoning in humans, and recently offline neural networks for the RPM problem have been proposed. In this paper, we establish experimental baselines, protocols, and forward and backward transfer metrics to evaluate continual learners on RPMs. We employ experience replay to mitigate catastrophic forgetting. Prior work using replay for image classification tasks has found that selectively choosing the samples to replay offers little, if any, benefit over random selection. In contrast, we find that selective replay can significantly outperform random selection for the RPM task.
To appear in the IEEE Conference on Computer Vision and Pattern Recognition Workshop (CVPR-W) on Continual Learning in Computer Vision (CLVision) 2021
References in corpus (9)
- Distilling the Knowledge in a Neural Network
- Efficient Lifelong Learning with A-GEM
- A Multi-World Approach to Question Answering about Real-World Scenes based on Uncertain Input
- A Comprehensive Study of Class Incremental Learning Algorithms for Visual Tasks
- Measuring Catastrophic Forgetting in Neural Networks
- Learning Perceptual Inference by Contrasting
- Abstract Reasoning with Distracting Features
- RODEO: Replay for Online Object Detection
- Attention on Abstract Visual Reasoning