3 citations · 7 across the 16 of their papers we have counts for
1 paper · 2 filters
Zhaoxuan Wu, Zijian Zhou, Arun Verma +3
We propose TETRIS, a novel method that optimizes the total throughput of batch speculative decoding in multi-request settings. Unlike existing methods that optimize for a single re…