565 citations · 756 across the 13 of their papers we have counts for
3 papers · 1 filter
Do Offline Metrics Predict Online Performance in Recommender Systems?
Karl Krauth, Sarah Dean, Alex Zhao +4
Recommender systems operate in an inherently dynamical setting. Past recommendations influence future behavior, including which data points are observed and how user preferences ch…
Exploration in two-stage recommender systems
Jiri Hron, Karl Krauth, Michael I. Jordan +1
Two-stage recommender systems are widely adopted in industry due to their scalability and maintainability. These systems produce recommendations in two steps: (i) multiple nominato…
The Effect of Natural Distribution Shift on Question Answering Models
John Miller, Karl Krauth, Benjamin Recht +1
We build four new test sets for the Stanford Question Answering Dataset (SQuAD) and evaluate the ability of question-answering systems to generalize to new data. Our first test set…