7 citations · 13 across the 34 of their papers we have counts for
4 papers · 2 filters
LT-Soups: Bridging Head and Tail Classes via Subsampled Model Soups
Masih Aminbeidokhti, Subhankar Roy, Eric Granger +2
Real-world datasets typically exhibit long-tailed (LT) distributions, where a few head classes dominate and many tail classes are severely underrepresented. While recent work shows…
High-Rate Mixout: Revisiting Mixout for Robust Domain Generalization
Masih Aminbeidokhti, Heitor Rapela Medeiros, Srikanth Muralidharan +2
Ensembling fine-tuned models initialized from powerful pre-trained weights is a common strategy to improve robustness under distribution shifts, but it comes with substantial compu…
Robust and Efficient Finetuning of Vision Foundation Models via Implicit Ensembling
Masih Aminbeidokhti, Heitor Rapela Medeiros, Eric Granger +1
Robust finetuning of foundation models seeks to improve out-of-distribution (OOD) generalization during in-distribution (ID) adaptation. We revisit Mixout, a stochastic regularizer…
Learning from Stochastic Teacher Representations Using Student-Guided Knowledge Distillation
Muhammad Haseeb Aslam, Clara Martinez, Marco Pedersoli +3
Advances in self-distillation have shown that when knowledge is distilled from a teacher to a student using the same deep learning (DL) architecture, the student performance can su…