Distilling Vision Transformers for Distortion-Robust Representation Learning

Konstantinos Alexis, Giorgos Giannopoulos, Dimitrios Gunopulos

Self-supervised learning has achieved remarkable success in learning visual representations from clean data, yet remains challenging when clean observations are sparse or not avail…