Improving Generative Pre-Training: An In-depth Study of Masked Image Modeling and Denoising Models

Hyesong Choi, Daeun Kim, Sungmin Cha +2

In this work, we dive deep into the impact of additive noise in pre-training deep networks. While various methods have attempted to use additive noise inspired by the success of la…