A unifying view for performance measures in multi-class prediction

Abstract

In the last few years, many different performance measures have been introduced to overcome the weakness of the most natural metric, the Accuracy. Among them, Matthews Correlation Coefficient has recently gained popularity among researchers not only in machine learning but also in several application fields such as bioinformatics. Nonetheless, further novel functions are being proposed in literature. We show that Confusion Entropy, a recently introduced classifier performance measure for multi-class problems, has a strong (monotone) relation with the multi-class generalization of a classical metric, the Matthews Correlation Coefficient. Computational evidence in support of the claim is provided, together with an outline of the theoretical explanation.

Cited by in corpus (9)

• Insights into Performance Fitness and Error Metrics for Machine Learning
• The MCC-F1 curve: a performance evaluation technique for binary classification
• Establishing a common data base of ice experiments and using machine learning to understand and predict ice behavior
• Diagnosis Support of Sickle Cell Anemia by Classifying Red Blood Cell Shape in Peripheral Blood Images
• Weighting Scheme for a Pairwise Multi-label Classifier Based on the Fuzzy Confusion Matrix
• Convolutional neural networks for structured omics: OmicsCNN and the OmicsConv layer
• On Mathews Correlation Coefficient and Improved Distance Map Loss for Automatic Glacier Calving Front Segmentation in SAR Imagery
• Inflation of test accuracy due to data leakage in deep learning-based classification of OCT images
• Refinement of genetic variants needs attention