937 citations · 3.8k across the 80 of their papers we have counts for
87 papers
How Reusable Are Benchmarks with Richer Feedback?
Youssef Allouah, John Duchi
We study whether benchmarks reliably guide model selection as developers adapt to evaluation feedback across multiple criteria. We find that the worst-case test-set size needed to…
Finding a stationary point of a stochastic convex problem
Felipe Areces, John Duchi, Malo Sommers
We consider the problem of finding stationary points for stochastic convex optimization problems. Rather than surrogates to stationarity, such as a proximity-to-stationarity guaran…
Predictive Inference in Multi-environment Scenarios
John C. Duchi, Suyash Gupta, Kuanhao Jiang +1
We address the challenge of constructing valid confidence intervals and sets in problems of prediction across multiple environments. We investigate two types of coverage suitable f…
An information-theoretic lower bound in time-uniform estimation
John C. Duchi, Saminul Haque
We present an information-theoretic lower bound for the problem of parameter estimation with time-uniform coverage guarantees. Via a new a reduction to sequential testing, we obtai…
PPI++: Efficient Prediction-Powered Inference
Anastasios N. Angelopoulos, John C. Duchi, Tijana Zrnic
We present PPI++: a computationally lightweight methodology for estimation and inference based on a small labeled dataset and a typically much larger dataset of machine-learning pr…
Collaboratively Learning Linear Models with Structured Missing Data
Chen Cheng, Gary Cheng, John Duchi
We study the problem of collaboratively learning least squares estimates for agents. Each agent observes a different subset of the features$\unicode{x2013}$e.g., containing dat…