Contrastive Distillation Is a Sample-Efficient Self-Supervised Loss Policy for Transfer Learning

Chris Lengerich, Gabriel Synnaeve, Amy Zhang +4

Traditional approaches to RL have focused on learning decision policies directly from episodic decisions, while slowly and implicitly learning the semantics of compositional repres…