Robust Partial-Label Learning by Leveraging Class Activation Values

Abstract

Real-world training data is often noisy; for example, human annotators assign conflicting class labels to the same instances. Partial-label learning (PLL) is a weakly supervised learning paradigm that allows training classifiers in this context without manual data cleaning. While state-of-the-art methods have good predictive performance, their predictions are sensitive to high noise levels, out-of-distribution data, and adversarial perturbations. We propose a novel PLL method based on subjective logic, which explicitly represents uncertainty by leveraging the magnitudes of the underlying neural network's class activation values. Thereby, we effectively incorporate prior knowledge about the class labels by using a novel label weight re-distribution strategy that we prove to be optimal. We empirically show that our method yields more robust predictions in terms of predictive performance under high PLL noise levels, handling out-of-distribution examples, and handling adversarial perturbations on the test instances.

References in corpus (13)

• Explaining and Harnessing Adversarial Examples
• Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms
• Aleatoric and Epistemic Uncertainty in Machine Learning: An Introduction to Concepts and Methods
• Towards Deep Learning Models Resistant to Adversarial Attacks
• Simple and Scalable Predictive Uncertainty Estimation using Deep Ensembles
• Evidential Deep Learning to Quantify Classification Uncertainty
• Semi-supervised Credit Card Fraud Detection via Attribute-Driven Graph Representation
• Progressive Identification of True Labels for Partial-Label Learning
• Learning with Feature-Dependent Label Noise: A Progressive Approach
• Progressive Purification for Instance-Dependent Partial Label Learning
• Structured Prediction with Partial Labelling through the Infimum Loss
• Two Sides of Miscalibration: Identifying Over and Under-Confidence Prediction for Network Calibration
• Partial-Label Learning with Conformal Candidate Cleaning