4 papers
Overcoming Long-term Catastrophic Forgetting through Adversarial Neural Pruning and Synaptic Consolidation
Jian Peng, Bo Tang, Hao Jiang +4
Artificial neural networks face the well-known problem of catastrophic forgetting. What's worse, the degradation of previously learned skills becomes more severe as the task sequen…
Understanding the Importance of Single Directions via Representative Substitution
Li Chen, Hailun Ding, Qi Li +3
Understanding the internal representations of deep neural networks (DNNs) is crucal to explain their behavior. The interpretation of individual units, which are neurons in MLPs or…
Understanding the Importance of Single Directions via Representative Substitution
Li Chen, Hailun Ding, Qi Li +3
Understanding the internal representations of deep neural networks (DNNs) is crucal to explain their behavior. The interpretation of individual units, which are neurons in MLPs or…
Overcoming Catastrophic Forgetting by Soft Parameter Pruning
Jian Peng, Jiang Hao, Zhuo Li +5
Catastrophic forgetting is a challenge issue in continual learning when a deep neural network forgets the knowledge acquired from the former task after learning on subsequent tasks…