Decoupling "when to update" from "how to update"

Abstract

Deep learning requires data. A useful approach to obtain data is to be creative and mine data from various sources, that were created for different purposes. Unfortunately, this approach often leads to noisy labels. In this paper, we propose a meta algorithm for tackling the noisy labels problem. The key idea is to decouple "when to update" from "how to update". We demonstrate the effectiveness of our algorithm by mining data for gender classification by combining the Labeled Faces in the Wild (LFW) face recognition dataset with a textual genderizing service, which leads to a noisy dataset. While our approach is very simple to implement, it leads to state-of-the-art results. We analyze some convergence properties of the proposed algorithm.

References in corpus (5)

• Training Deep Neural Networks on Noisy Labels with Bootstrapping
• Training Convolutional Networks with Noisy Labels
• Loss factorization, weakly supervised learning and label noise robustness
• Learning from Binary Labels with Instance-Dependent Corruption
• Attend in groups: a weakly-supervised deep learning framework for learning from web data

Cited by in corpus (16)

• Multimodal Co-learning: Challenges, Applications with Datasets, Recent Advances and Future Directions
• Low-Quality Training Data Only? A Robust Framework for Detecting Encrypted Malicious Network Traffic
• Learning from Noisy Labels for Entity-Centric Information Extraction
• Boosting Facial Expression Recognition by A Semi-Supervised Progressive Teacher
• Open-set Label Noise Can Improve Robustness Against Inherent Label Noise
• MetaLabelNet: Learning to Generate Soft-Labels from Noisy-Labels
• NRGNN: Learning a Label Noise-Resistant Graph Neural Network on Sparsely and Noisily Labeled Graphs
• Dirichlet-Based Prediction Calibration for Learning with Noisy Labels
• Narrowing the Gap: Improved Detector Training with Noisy Location Annotations
• Affect Expression Behaviour Analysis in the Wild using Consensual Collaborative Training
• Consensual Collaborative Training And Knowledge Distillation Based Facial Expression Recognition Under Noisy Annotations
• PNT-Edge: Towards Robust Edge Detection with Noisy Labels by Learning Pixel-level Noise Transitions
• ReSmooth: Detecting and Utilizing OOD Samples when Training with Data Augmentation
• Collaborative Label Correction via Entropy Thresholding
• On the Robustness of Monte Carlo Dropout Trained with Noisy Labels
• Mitigating Memorization in Sample Selection for Learning with Noisy Labels