Energy-Inspired Self-Supervised Pretraining for Vision Models

Ze Wang, Jiang Wang, Zicheng Liu +1

Motivated by the fact that forward and backward passes of a deep network naturally form symmetric mappings between input and output representations, we introduce a simple yet effec…