Img2Vec: A Teacher of High Token-Diversity Helps Masked AutoEncoders

Heng Pan, Chenyang Liu, Wenxiao Wang +4

We present a pipeline of Image to Vector (Img2Vec) for masked image modeling (MIM) with deep features. To study which type of deep features is appropriate for MIM as a learning tar…