RAE-AR: Taming Autoregressive Models with Representation Autoencoders

Hu Yu, Hang Xu, Jie Huang +4

The latent space of generative modeling is long dominated by the VAE encoder. The latents from the pretrained representation encoders (e.g., DINO, SigLIP, MAE) are previously consi…