28 citations · 28 across the 1 of their papers we have counts for
1 paper
Charlie Chen, Sebastian Borgeaud, Geoffrey Irving +3
We present speculative sampling, an algorithm for accelerating transformer decoding by enabling the generation of multiple tokens from each transformer call. Our algorithm relies o…