90 citations · 141 across the 6 of their papers we have counts for
7 papers · 1 filter
Continual Learning Beyond a Single Model
Thang Doan, Seyed Iman Mirzadeh, Mehrdad Farajtabar
A growing body of research in continual learning focuses on the catastrophic forgetting problem. While many attempts have been made to alleviate this problem, the majority of the m…
Architecture Matters in Continual Learning
Seyed Iman Mirzadeh, Arslan Chaudhry, Dong Yin +4
A large body of research in continual learning is devoted to overcoming the catastrophic forgetting of neural networks by designing new algorithms that are robust to the distributi…
Linear Mode Connectivity in Multitask and Continual Learning
Seyed Iman Mirzadeh, Mehrdad Farajtabar, Dilan Gorur +2
Continual (sequential) training and multitask (simultaneous) training are often attempting to solve the same overall objective: to find a solution that performs well on all conside…
Understanding the Role of Training Regimes in Continual Learning
Seyed Iman Mirzadeh, Mehrdad Farajtabar, Razvan Pascanu +1
Catastrophic forgetting affects the training of neural networks, limiting their ability to learn multiple tasks sequentially. From the perspective of the well established plasticit…
Dropout as an Implicit Gating Mechanism For Continual Learning
Seyed-Iman Mirzadeh, Mehrdad Farajtabar, Hassan Ghasemzadeh
In recent years, neural networks have demonstrated an outstanding ability to achieve complex learning tasks across various domains. However, they suffer from the "catastrophic forg…
ActiLabel: A Combinatorial Transfer Learning Framework for Activity Recognition
Parastoo Alinia, Iman Mirzadeh, Hassan Ghasemzadeh
Sensor-based human activity recognition has become a critical component of many emerging applications ranging from behavioral medicine to gaming. However, an unprecedented increase…
Improved Knowledge Distillation via Teacher Assistant
Seyed-Iman Mirzadeh, Mehrdad Farajtabar, Ang Li +3
Despite the fact that deep neural networks are powerful models and achieve appealing results on many tasks, they are too large to be deployed on edge devices like smartphones or em…