MV-MR: multi-views and multi-representations for self-supervised learning and knowledge distillation

Vitaliy Kinakh, Mariia Drozdova, Slava Voloshynovskiy

We present a new method of self-supervised learning and knowledge distillation based on the multi-views and multi-representations (MV-MR). The MV-MR is based on the maximization of…