A Unified View of Multi-Label Performance Measures
arXiv:1609.00288
Abstract
Multi-label classification deals with the problem where each instance is associated with multiple class labels. Because evaluation in multi-label classification is more complicated than single-label setting, a number of performance measures have been proposed. It is noticed that an algorithm usually performs differently on different measures. Therefore, it is important to understand which algorithms perform well on which measure(s) and why. In this paper, we propose a unified margin view to revisit eleven performance measures in multi-label classification. In particular, we define label-wise margin and instance-wise margin, and prove that through maximizing these margins, different corresponding performance measures will be optimized. Based on the defined margins, a max-margin approach called LIMO is designed and empirical results verify our theoretical findings.
Cited by in corpus (14)
- Recurrently Exploring Class-wise Attention in A Hybrid Convolutional and Bidirectional LSTM Network for Multi-label Aerial Image Classification
- Joint Ranking SVM and Binary Relevance with Robust Low-Rank Learning for Multi-Label Classification
- Multi-Label Learning with Deep Forest
- Graph Neural Networks for Knowledge Enhanced Visual Representation of Paintings
- A Systematic Study of Cross-Project Defect Prediction With Meta-Learning
- sigmoidF1: A Smooth F1 Score Surrogate Loss for Multilabel Classification
- Multi-label Ranking: Mining Multi-label and Label Ranking Data
- The iMaterialist Fashion Attribute Dataset
- Rethinking and Reweighting the Univariate Losses for Multi-Label Ranking: Consistency and Generalization
- Ensemble model for pre-discharge icd10 coding prediction
- Self-Paced Multi-Label Learning with Diversity
- Where and When: Space-Time Attention for Audio-Visual Explanations
- IIITM Face: A Database for Facial Attribute Detection in Constrained and Simulated Unconstrained Environments
- Collaborative residual learners for automatic icd10 prediction using prescribed medications