Parallel Token Prediction for Language Models

Felix Draxler, Justus Will, Farrin Marouf Sofian +3

Autoregressive decoding in language models is inherently slow, generating only one token per forward pass. We propose Parallel Token Prediction (PTP), a general-purpose framework f…