Validation of the Practicability of Logical Assessment Formula for Evaluations with Inaccurate Ground-Truth Labels: An Application Study on Tumour Segmentation for Breast Cancer

Abstract

The logical assessment formula (LAF) is a new theory proposed for evaluations with inaccurate ground-truth labels (IAGTLs) to assess the predictive models for artificial intelligence applications. However, the practicability of LAF for evaluations with IAGTLs has not yet been validated in real-world practice. In this paper, we applied LAF to two tasks of tumour segmentation for breast cancer (TSfBC) in medical histopathology whole slide image analysis (MHWSIA) for evaluations with IAGTLs. Experimental results and analysis show that the LAF-based evaluations with IAGTLs were unable to confidently act like usual evaluations with accurate ground-truth labels on the one easier task of TSfBC while being able to reasonably act like usual evaluations with AGTLs on the other more difficult task of TSfBC. These results and analysis reflect the potential of LAF applied to MHWSIA for evaluations with IAGTLs. This paper presents the first practical validation of LAF for evaluations with IAGTLs in a real-world application.

This is the final published version

References in corpus (9)

• Training Deep Neural Networks on Noisy Labels with Bootstrapping
• Unsupervised Label Noise Modeling and Loss Correction
• Normalized Loss Functions for Deep Learning with Noisy Labels
• Dual T: Reducing Estimation Error for Transition Matrix in Label-noise Learning
• One-Step Abductive Multi-Target Learning with Diverse Noisy Samples and Its Application to Tumour Segmentation for Breast Cancer
• A Framework for Cluster and Classifier Evaluation in the Absence of Reference Labels
• Handling Noisy Labels via One-Step Abductive Multi-Target Learning and Its Application to Helicobacter Pylori Segmentation
• Logical Assessment Formula and Its Principles for Evaluations with Inaccurate Ground-Truth Labels
• Evaluating Classifiers Without Expert Labels