431 citations · 844 across the 46 of their papers we have counts for
Showing 2018Show all
3 papers · 1 filter
cs.LG2018★ 2 cited
Closed-Loop Memory GAN for Continual Learning
Amanda Rios, Laurent Itti
Sequential learning of tasks using gradient descent leads to an unremitting decline in the accuracy of tasks for which training data is no longer available, termed catastrophic for…
stat.ML2018★ 431 cited
Born Again Neural Networks
Tommaso Furlanello, Zachary C. Lipton, Michael Tschannen +2
Knowledge Distillation (KD) consists of transferring “knowledge†from one machine learning model (the teacher) to another (the student). Commonly, the teacher is a high-capacit…
cs.LG2018★ 12 cited
Overcoming catastrophic forgetting problem by weight consolidation and long-term memory
Shixian Wen, Laurent Itti
Sequential learning of multiple tasks in artificial neural networks using gradient descent leads to catastrophic forgetting, whereby previously learned knowledge is erased during l…