565 citations · 889 across the 33 of their papers we have counts for
1 paper · 2 filters
Clara Mohri, Haim Kaplan, Tal Schuster +2
Transformer language models generate text autoregressively, making inference latency proportional to the number of tokens generated. Speculative decoding reduces this latency witho…