Latent Denoising Makes Good Tokenizers

Jiawei Yang, Tianhong Li, Lijie Fan +2

Despite their fundamental role, it remains unclear what properties could make tokenizers more effective for generative modeling. We observe that modern generative models share a co…