Compression-aware Continual Learning using Singular Value Decomposition

Varigonda Pavan Teja, Priyadarshini Panda

We propose a compression based continual task learning method that can dynamically grow a neural network. Inspired from the recent model compression techniques, we employ compressi…