activity
20142024
most citedUnderspecification Presents Challenges for Credibility in Modern Machine Learning

430 citations · 1.2k across the 40 of their papers we have counts for

collaborators
Showing 2020Show all

6 papers · 1 filter

cs.DB2020★ 14 cited

Learned Indexes for a Google-scale Disk-based Database

Hussam Abu-Libdeh, Deniz Altınbüken, Alex Beutel +7

There is great excitement about learned index structures, but understandable skepticism about the practicality of a new method uprooting decades of research on B-Trees. In this pap…

cs.LG2020★ 430 cited

Underspecification Presents Challenges for Credibility in Modern Machine Learning

Alexander D'Amour, Katherine Heller, Dan Moldovan +37

ML models often exhibit unexpectedly poor behavior when they are deployed in real-world domains. We identify underspecification as a key reason for these failures. An ML pipeline i…

cs.CL2020★ 7 cited

CAT-Gen: Improving Robustness in NLP Models via Controlled Adversarial Text Generation

Tianlu Wang, Xuezhi Wang, Yao Qin +5

NLP models are shown to suffer from robustness issues, i.e., a model's prediction can be easily changed under small perturbations to the input. In this work, we present a Controlle…

cs.CL2020★ 106 cited

Measuring and Reducing Gendered Correlations in Pre-trained Models

Kellie Webster, Xuezhi Wang, Ian Tenney +6

Pre-trained models have revolutionized natural language understanding. However, researchers have found they can encode artifacts undesired in many applications, such as professions…

cs.LG2020★ 8 cited

Improving Calibration through the Relationship with Adversarial Robustness

Yao Qin, Xuezhi Wang, Alex Beutel +1

Neural networks lack adversarial robustness, i.e., they are vulnerable to adversarial examples that through small perturbations to inputs cause incorrect predictions. Further, trus…

cs.LG2020★ 46 cited

Fairness without Demographics through Adversarially Reweighted Learning

Preethi Lahoti, Alex Beutel, Jilin Chen +5

Much of the previous machine learning (ML) fairness literature assumes that protected features such as race and sex are present in the dataset, and relies upon them to mitigate fai…