Certifying Model Upgrades with Slice-Wise Non-Regression and Incumbent Fallback

Shengwei Zhang, Tao Wu, Fei Qian

An updated model can improve an aggregate metric while degrading a slice that matters to a downstream user. We study checkpoint selection subject to non-regression tolerances relat…