74 citations · 100 across the 8 of their papers we have counts for
4 papers · 1 filter
DataComp: In search of the next generation of multimodal datasets
Samir Yitzhak Gadre, Gabriel Ilharco, Alex Fang +31
Multimodal datasets are a critical component in recent breakthroughs such as Stable Diffusion and GPT-4, yet their design does not receive the same research attention as model arch…
The Role of Pre-training Data in Transfer Learning
Rahim Entezari, Mitchell Wortsman, Olga Saukh +3
The transfer learning paradigm of model pre-training and subsequent fine-tuning produces high-accuracy models. While most studies recommend scaling the pre-training size to benefit…
Understanding the effect of sparsity on neural networks robustness
Lukas Timpl, Rahim Entezari, Hanie Sedghi +2
This paper examines the impact of static sparsity on the robustness of a trained network to weight perturbations, data corruption, and adversarial examples. We show that, up to a c…
AVID: Adversarial Visual Irregularity Detection
Mohammad Sabokrou, Masoud Pourreza, Mohsen Fayyaz +4
Real-time detection of irregularities in visual data is very invaluable and useful in many prospective applications including surveillance, patient monitoring systems, etc. With th…