activity
20192022
most citedUnderstanding the Role of Training Regimes in Continual Learning

90 citations · 115 across the 2 of their papers we have counts for

collaborators

6 papers

cs.LG202225 cited

Architecture Matters in Continual Learning

Seyed Iman Mirzadeh, Arslan Chaudhry, Dong Yin +4

A large body of research in continual learning is devoted to overcoming the catastrophic forgetting of neural networks by designing new algorithms that are robust to the distributi…

cs.LG2020

Linear Mode Connectivity in Multitask and Continual Learning

Seyed Iman Mirzadeh, Mehrdad Farajtabar, Dilan Gorur +2

Continual (sequential) training and multitask (simultaneous) training are often attempting to solve the same overall objective: to find a solution that performs well on all conside…

cs.LG202090 cited

Understanding the Role of Training Regimes in Continual Learning

Seyed Iman Mirzadeh, Mehrdad Farajtabar, Razvan Pascanu +1

Catastrophic forgetting affects the training of neural networks, limiting their ability to learn multiple tasks sequentially. From the perspective of the well established plasticit…

cs.LG2020

Dropout as an Implicit Gating Mechanism For Continual Learning

Seyed-Iman Mirzadeh, Mehrdad Farajtabar, Hassan Ghasemzadeh

In recent years, neural networks have demonstrated an outstanding ability to achieve complex learning tasks across various domains. However, they suffer from the "catastrophic forg…

cs.LG2020

ActiLabel: A Combinatorial Transfer Learning Framework for Activity Recognition

Parastoo Alinia, Iman Mirzadeh, Hassan Ghasemzadeh

Sensor-based human activity recognition has become a critical component of many emerging applications ranging from behavioral medicine to gaming. However, an unprecedented increase…

cs.LG2019

Improved Knowledge Distillation via Teacher Assistant

Seyed-Iman Mirzadeh, Mehrdad Farajtabar, Ang Li +3

Despite the fact that deep neural networks are powerful models and achieve appealing results on many tasks, they are too large to be deployed on edge devices like smartphones or em…