1 citations · 1 across the 5 of their papers we have counts for
1 paper · 1 filter
Jameson Sandler, Ahmet Üstün, Marco Romanelli +2
The practice of speculative decoding, whereby inference is probabilistically supported by a smaller, cheaper, ``drafter'' model, has become a standard technique for systematically…