activity
20172023
most citedUnderspecification Presents Challenges for Credibility in Modern Machine Learning

430 citations · 510 across the 9 of their papers we have counts for

collaborators
Showing cs.LGShow all

6 papers · 1 filter

cs.LG2023

Out of the Ordinary: Spectrally Adapting Regression for Covariate Shift

Benjamin Eyre, Elliot Creager, David Madras +2

Designing deep neural network classifiers that perform robustly on distributions differing from the available training data is an active area of machine learning research. However,…

cs.LG20217 cited

Counterfactual Invariance to Spurious Correlations: Why and How to Pass Stress Tests

Victor Veitch, Alexander D'Amour, Steve Yadlowsky +1

Informally, a 'spurious correlation' is the dependence of a model on some aspect of the input data that an analyst thinks shouldn't matter. In machine learning, these have a know-i…

cs.LG2020430 cited

Underspecification Presents Challenges for Credibility in Modern Machine Learning

Alexander D'Amour, Katherine Heller, Dan Moldovan +37

ML models often exhibit unexpectedly poor behavior when they are deployed in real-world domains. We identify underspecification as a key reason for these failures. An ML pipeline i…

cs.LG2020

Evaluating Prediction-Time Batch Normalization for Robustness under Covariate Shift

Zachary Nado, Shreyas Padhy, D. Sculley +3

Covariate shift has been shown to sharply degrade both predictive accuracy and the calibration of uncertainty estimates for deep learning models. This is worrying, because covariat…

cs.LG20192 cited

A Biologically Plausible Benchmark for Contextual Bandit Algorithms in Precision Oncology Using in vitro Data

Niklas T. Rindtorff, MingYu Lu, Nisarg A. Patel +2

Precision oncology, the genetic sequencing of tumors to identify druggable targets, has emerged as the standard of care in the treatment of many cancers. Nonetheless, due to the pa…

cs.LG20181 cited

BriarPatches: Pixel-Space Interventions for Inducing Demographic Parity

Alexey A. Gritsenko, Alex D'Amour, James Atwood +2

We introduce the BriarPatch, a pixel-space intervention that obscures sensitive attributes from representations encoded in pre-trained classifiers. The patches encourage internal m…