4 citations · 7 across the 7 of their papers we have counts for
1 paper · 1 filter
Ranran Haoran Zhang, Soumik Dey, Ashirbad Mishra +3
Inference optimizations are routinely evaluated by throughput alone, without verifying output correctness. We conduct a forensic analysis of batch speculative decoding and find tha…