Sequential mastery of multiple visual tasks: Networks naturally learn to learn and forget to forget

Guy Davidson, Michael C. Mozer

We explore the behavior of a standard convolutional neural net in a continual-learning setting that introduces visual classification tasks sequentially and requires the net to mast…