Not All Forgetting Is Equal: Retention Dynamics in Fine-Tuned Image Classifiers

Miit Daga, Swarna Priya Ramu

Fine-tuning a pretrained classifier leaves some samples reliably learned and others cycling between correct and incorrect. Curriculum learning, data pruning and dataset cartography…