Beyond the Training Distribution: Evaluating Predictions Under Distribution Shift and Selection Bias

Annie Ulichney, Amanda Coston

Understanding how a prediction model will perform in a new environment before deployment is essential to preventing harm when algorithms inform decision-making. Two common sources…