3 papers
cs.LG2026
Performance Estimation in Binary Classification Using Calibrated Confidence
Juhani Kivimäki, Jakub BiaÅek, Wojtek Kuberski +1
Model monitoring is a critical component of the machine learning lifecycle, safeguarding against undetected drops in the model's performance after deployment. Traditionally, perfor…
cs.LG2025
Estimating Model Performance Under Covariate Shift Without Labels
Jakub BiaÅek, Juhani Kivimäki, Wojtek Kuberski +1
After deployment, machine learning models often experience performance degradation due to shifts in data distribution. It is challenging to assess post-deployment performance accur…
cs.LG2025
Confidence-based Estimators for Predictive Performance in Model Monitoring
Juhani Kivimäki, Jakub BiaÅek, Jukka K. Nurminen +1
After a machine learning model has been deployed into production, its predictive performance needs to be monitored. Ideally, such monitoring can be carried out by comparing the mod…