Robust Validation: Confident Predictions Even When Distributions Shift

Maxime Cauchois, Suyash Gupta, Alnur Ali +1

While the traditional viewpoint in machine learning and statistics assumes training and testing samples come from the same population, practice belies this fiction. One strategy --…