SP${}^2$ec: Adaptive Self-Speculative Decoding for Vision-Language Models

Yuqi Huang, Xingyao Li, Yunlong Hou +3

Speculative Decoding (SD) has demonstrated its efficacy in accelerating large language model inference, but for Vision-Language Models (VLMs), the diverse input modalities make it…