On Continuous Monitoring of Risk Violations under Unknown Shift

Alexander Timans, Rajeev Verma, Eric Nalisnick +1

Machine learning systems deployed in the real world must operate under dynamic and often unpredictable distribution shifts. This challenges the validity of statistical safety assur…