A Controlled Study of Self-Supervised Image and Video Pretraining under Limited Resources

Brunó B. Englert, Gijs Dubbelman

Visual foundation models are a cornerstone of image and video understanding but typically require large amounts of data and computation. The current scale required for pretraining…