Continuous Autoregressive Models with Noise Augmentation Avoid Error Accumulation

Marco Pasini, Javier Nistal, Stefan Lattner +1

Autoregressive models are typically applied to sequences of discrete tokens, but recent research indicates that generating sequences of continuous embeddings in an autoregressive m…