Leveraging Random Label Memorization for Unsupervised Pre-Training

Vinaychandran Pondenkandath, Michele Alberti, Sammer Puran +2

We present a novel approach to leverage large unlabeled datasets by pre-training state-of-the-art deep neural networks on randomly-labeled datasets. Specifically, we train the neur…