4 papers
Controlling Neural Collapse Enhances Out-of-Distribution Detection and Transfer Learning
Md Yousuf Harun, Jhair Gallardo, Christopher Kanan
Out-of-distribution (OOD) detection and OOD generalization are widely studied in Deep Neural Networks (DNNs), yet their relationship remains poorly understood. We empirically show…
What Variables Affect Out-of-Distribution Generalization in Pretrained Models?
Md Yousuf Harun, Kyungbok Lee, Jhair Gallardo +2
Embeddings produced by pre-trained deep neural networks (DNNs) are widely used; however, their efficacy for downstream tasks can vary widely. We study the factors influencing trans…
GRASP: A Rehearsal Policy for Efficient Online Continual Learning
Md Yousuf Harun, Jhair Gallardo, Junyu Chen +1
Continual learning (CL) in deep neural networks (DNNs) involves incrementally accumulating knowledge in a DNN from a growing data stream. A major challenge in CL is that non-statio…
Self-Supervised Training Enhances Online Continual Learning
Jhair Gallardo, Tyler L. Hayes, Christopher Kanan
In continual learning, a system must incrementally learn from a non-stationary data stream without catastrophic forgetting. Recently, multiple methods have been devised for increme…