Representation Stability as a Regularizer for Improved Text Analytics Transfer Learning

Matthew Riemer, Elham Khabiri, Richard Goodwin

Although neural networks are well suited for sequential transfer learning tasks, the catastrophic forgetting problem hinders proper integration of prior knowledge. In this work, we…