Self-Distillation for Multi-Token Prediction

Guoliang Zhao, Ruobing Xie, An Wang +3

As Large Language Models (LLMs) scale up, inference efficiency becomes a critical bottleneck. Multi-Token Prediction (MTP) could accelerate LLM inference by predicting multiple fut…