activity
20122025
most citedScaling Vision Transformers to 22 Billion Parameters

118 citations · 363 across the 33 of their papers we have counts for

collaborators
Showing 2022Show all

7 papers · 1 filter

stat.ML2022★ 3 cited

Adapting to Latent Subgroup Shifts via Concepts and Proxies

Ibrahim Alabdulmohsin, Nicole Chiou, Alexander D'Amour +7

We address the problem of unsupervised domain adaptation when the source domain differs from the target domain because of a shift in the distribution of a latent subgroup. When thi…

cs.CV2022★ 2 cited

FlexiViT: One Model for All Patch Sizes

Lucas Beyer, Pavel Izmailov, Alexander Kolesnikov +7

Vision Transformers convert images to sequences by slicing them into patches. The size of these patches controls a speed/accuracy tradeoff, with smaller patches leading to higher a…

cs.LG2022

Layer-Stack Temperature Scaling

Amr Khalifa, Michael C. Mozer, Hanie Sedghi +2

Recent works demonstrate that early layers in a neural network contain useful information for prediction. Inspired by this, we show that extending temperature scaling across all la…

cs.LG2022★ 22 cited

Revisiting Neural Scaling Laws in Language and Vision

Ibrahim Alabdulmohsin, Behnam Neyshabur, Xiaohua Zhai

The remarkable progress in deep learning in recent years is largely driven by improvements in scale, where bigger models are trained on larger datasets for longer schedules. To pre…

cs.LG2022★ 3 cited

A Reduction to Binary Approach for Debiasing Multiclass Datasets

Ibrahim Alabdulmohsin, Jessica Schrouff, Oluwasanmi Koyejo

We propose a novel reduction-to-binary (R2B) approach that enforces demographic parity for multiclass classification with non-binary sensitive attributes via a reduction to a seque…

cs.LG2022★ 32 cited

Diagnosing failures of fairness transfer across distribution shift in real-world medical settings

Jessica Schrouff, Natalie Harris, Oluwasanmi Koyejo +14

Diagnosing and mitigating changes in model fairness under distribution shift is an important component of the safe deployment of machine learning in healthcare settings. Importantl…