Task-agnostic Continual Learning with Hybrid Probabilistic Models

Abstract

Learning new tasks continuously without forgetting on a constantly changing data distribution is essential for real-world problems but extremely challenging for modern deep learning. In this work we propose HCL, a Hybrid generative-discriminative approach to Continual Learning for classification. We model the distribution of each task and each class with a normalizing flow. The flow is used to learn the data distribution, perform classification, identify task changes, and avoid forgetting, all leveraging the invertibility and exact likelihood which are uniquely enabled by the normalizing flow model. We use the generative capabilities of the flow to avoid catastrophic forgetting through generative replay and a novel functional regularization technique. For task identification, we use state-of-the-art anomaly detection techniques based on measuring the typicality of the model's statistics. We demonstrate the strong performance of HCL on a range of continual learning benchmarks such as split-MNIST, split-CIFAR, and SVHN-MNIST.

References in corpus (29)

• Adam: A Method for Stochastic Optimization
• Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
• Overcoming catastrophic forgetting in neural networks
• Semi-Supervised Learning with Deep Generative Models
• Density estimation using Real NVP
• Three scenarios for continual learning
• Re-evaluating Continual Learning Scenarios: A Categorization and Case for Strong Baselines
• Residual Flows for Invertible Generative Modeling
• Revisiting Natural Gradient for Deep Networks
• Dark Experience for General Continual Learning: a Strong, Simple Baseline
• Functional Regularisation for Continual Learning with Gaussian Processes
• Continual Unsupervised Representation Learning
• Learn to Grow: A Continual Structure Learning Framework for Overcoming Catastrophic Forgetting
• Life-Long Disentangled Representation Learning with Cross-Domain Latent Homologies
• Task Agnostic Continual Learning Using Online Variational Bayes
• Task Agnostic Continual Learning via Meta Learning
• Detecting Out-of-Distribution Inputs to Deep Generative Models Using Typicality
• Efficient Continual Learning in Neural Networks with Embedding Regularization
• Unified Probabilistic Deep Continual Learning through Generative Replay and Open Set Recognition
• Hybrid Models with Deep and Invertible Features
• Why Normalizing Flows Fail to Detect Out-of-Distribution Data
• Gradient Projection Memory for Continual Learning
• Semi-Conditional Normalizing Flows for Semi-Supervised Learning
• The Effectiveness of Memory Replay in Large Scale Continual Learning
• Density of States Estimation for Out-of-Distribution Detection
• Variational Prototype Replays for Continual Learning
• Learning latent representations across multiple data domains using Lifelong VAEGAN
• Hybrid Models for Open Set Recognition
• Pseudo-Rehearsal for Continual Learning with Normalizing Flows