37 citations · 39 across the 8 of their papers we have counts for
5 papers · 1 filter
Beyond Unimodal Learning: The Importance of Integrating Multiple Modalities for Lifelong Learning
Fahad Sarfraz, Bahram Zonooz, Elahe Arani
While humans excel at continual learning (CL), deep neural networks (DNNs) exhibit catastrophic forgetting. A salient feature of the brain that allows effective CL is that it utili…
Error Sensitivity Modulation based Experience Replay: Mitigating Abrupt Representation Drift in Continual Learning
Fahad Sarfraz, Elahe Arani, Bahram Zonooz
Humans excel at lifelong learning, as the brain has evolved to be robust to distribution shifts and noise in our ever-changing environment. Deep neural networks (DNNs), however, ex…
Learning Fast, Learning Slow: A General Continual Learning Method based on Complementary Learning System
Elahe Arani, Fahad Sarfraz, Bahram Zonooz
Humans excel at continually learning from an ever-changing environment whereas it remains a challenge for deep neural networks which exhibit catastrophic forgetting. The complement…
Knowledge Distillation Beyond Model Compression
Fahad Sarfraz, Elahe Arani, Bahram Zonooz
Knowledge distillation (KD) is commonly deemed as an effective model compression technique in which a compact model (student) is trained under the supervision of a larger pretraine…
Noise as a Resource for Learning in Knowledge Distillation
Elahe Arani, Fahad Sarfraz, Bahram Zonooz
While noise is commonly considered a nuisance in computing systems, a number of studies in neuroscience have shown several benefits of noise in the nervous system from enabling the…