Beyond the Speculative Game: A Survey of Speculative Execution in Large Language Models

Chen Zhang, Zhuorui Liu, Dawei Song

With the increasingly giant scales of (causal) large language models (LLMs), the inference efficiency comes as one of the core concerns along the improved performance. In contrast…