machine learning

Calibratable Disambiguation Loss for Multi-Instance Partial-Label Learning

arXiv:2512.17788

summary

The paper introduces a calibratable disambiguation loss (CDL) that improves both classification accuracy and confidence calibration for multi-instance partial-label learning by incorporating a margin between top candidate labels and competitors.

Abstract

Multi-instance partial-label learning (MIPL) is a weakly supervised framework that extends the principles of multi-instance learning (MIL) and partial-label learning (PLL) to address the challenges of inexact supervision in both instance and label spaces. However, existing MIPL approaches often suffer from poor calibration, undermining classifier reliability. In this work, we propose a plug-and-play calibratable disambiguation loss (CDL) for classification and calibration, which modulates a disambiguation objective by a top-vs-competitor prediction margin. The competitor is instantiated either as the second strongest candidate label or as the strongest non-candidate label, yielding two variants that respectively emphasize candidate-level separation and candidate-vs-non-candidate suppression. Theoretically, we analyze CDL as a margin-modulated momentum-based disambiguation loss (MDL) objective, derive a lower-bound and a pseudo-label confidence-alignment bound for calibration, and show through gradient and momentum analyses how margin shaping affects weight updates. Experimental results on benchmark and real-world MIPL datasets, together with representative PLL adaptation, confirm that our CDL significantly improves both classification accuracy and expected calibration error.

Accepted at IEEE TPAMI. The code can be found at \url{https://github.com/tangw-seu/MIPLCDL}

Topics & keywords

#multi-instance learning#partial-label learning#calibration#weak supervision#loss functionscalibratable disambiguation lossmargin-modulated lossexpected calibration errorpseudo-label confidencemulti-instance partial-label learning