3 citations · 6 across the 5 of their papers we have counts for
1 paper · 1 filter
Yangchao Wu, Zongyue Qin, Alex Wong +1
Speculative decoding is a technique to leverage hardware concurrency in order to enable multiple steps of token generation in a single forward pass, thus improving the efficiency o…