6 citations · 7 across the 8 of their papers we have counts for
1 paper · 1 filter
Jeff Shen, Zhejian Zhou, Ryan Lee +2
Speculative decoding accelerates large language model (LLM) inference by using a lightweight drafter to propose a block of tokens that the target model verifies in one parallel pas…