Bayesian Structure Adaptation for Continual Learning

Abstract

Continual Learning is a learning paradigm where learning systems are trained with sequential or streaming tasks. Two notable directions among the recent advances in continual learning with neural networks are ($i$) variational Bayes based regularization by learning priors from previous tasks, and, ($ii$) learning the structure of deep networks to adapt to new tasks. So far, these two approaches have been orthogonal. We present a novel Bayesian approach to continual learning based on learning the structure of deep neural networks, addressing the shortcomings of both these approaches. The proposed model learns the deep structure for each task by learning which weights to be used, and supports inter-task transfer through the overlapping of different sparse subsets of weights learned by different tasks. Experimental results on supervised and unsupervised benchmarks shows that our model performs comparably or better than recent advances in continual learning setting.

17 pages, 16 Figures, 3 Tables

References in corpus (18)

• Auto-Encoding Variational Bayes
• Overcoming catastrophic forgetting in neural networks
• Categorical Reparameterization with Gumbel-Softmax
• Weight Uncertainty in Neural Networks
• The Concrete Distribution: A Continuous Relaxation of Discrete Random Variables
• Continual Learning Through Synaptic Intelligence
• PathNet: Evolution Channels Gradient Descent in Super Neural Networks
• Progress & Compress: A scalable framework for continual learning
• Overcoming catastrophic forgetting with hard attention to the task
• Don't forget, there is more than forgetting: new metrics for Continual Learning
• Continual Learning via Neural Pruning
• Continual Unsupervised Representation Learning
• Functional Regularisation for Continual Learning with Gaussian Processes
• Learn to Grow: A Continual Structure Learning Framework for Overcoming Catastrophic Forgetting
• Task Agnostic Continual Learning Using Online Variational Bayes
• WHAI: Weibull Hybrid Autoencoding Inference for Deep Topic Modeling
• Stick-Breaking Variational Autoencoders
• Continual Learning with Adaptive Weights (CLAW)

Cited by in corpus (3)

• A Review of Uncertainty Quantification in Deep Learning: Techniques, Applications and Challenges
• Recent Advances of Continual Learning in Computer Vision: An Overview
• Hierarchical Indian Buffet Neural Networks for Bayesian Continual Learning