355 citations · 956 across the 20 of their papers we have counts for
Showing 2021Show all
2 papers · 1 filter
cs.CL2021★ 1 cited
Sharpness-Aware Minimization Improves Language Model Generalization
Dara Bahri, Hossein Mobahi, Yi Tay
The allure of superhuman-level capabilities has led to considerable interest in language models like GPT-3 and T5, wherein the research has, by and large, revolved around new model…
cs.LG2021★ 11 cited
The Low-Rank Simplicity Bias in Deep Networks
Minyoung Huh, Hossein Mobahi, Richard Zhang +3
Modern deep neural networks are highly over-parameterized compared to the data on which they are trained, yet they often generalize remarkably well. A flurry of recent work has ask…