Line-Coupled Language Model

Shiyuan Li, Shaorong Zhang, Zhaorui Yang +3

Autoregressive language models generate one token per decoding step, limiting the useful output of each forward pass. Although diffusion models, insertion-based decoding, and multi…