568 citations · 2.2k across the 54 of their papers we have counts for
4 papers · 2 filters
Understanding the Benefits of Image Augmentations
Matthew Iceland, Christopher Kanan
Image Augmentations are widely used to reduce overfitting in neural networks. However, the explainability of their benefits largely remains a mystery. We study which layers of resi…
Overcoming the Stability Gap in Continual Learning
Md Yousuf Harun, Christopher Kanan
Pre-trained deep neural networks (DNNs) are being widely deployed by industry for making business decisions and to serve users; however, a major problem is model decay, where the D…
How Efficient Are Today's Continual Learning Algorithms?
Md Yousuf Harun, Jhair Gallardo, Tyler L. Hayes +1
Supervised Continual learning involves updating a deep neural network (DNN) from an ever-growing stream of labeled data. While most work has focused on overcoming catastrophic forg…
SIESTA: Efficient Online Continual Learning with Sleep
Md Yousuf Harun, Jhair Gallardo, Tyler L. Hayes +2
In supervised continual learning, a deep neural network (DNN) is updated with an ever-growing data stream. Unlike the offline setting where data is shuffled, we cannot make any dis…