4 citations · 7 across the 10 of their papers we have counts for
1 paper · 2 filters
Ranran Haoran Zhang, Soumik Dey, Ashirbad Mishra +3
Inference optimizations are routinely evaluated by throughput alone, without verifying output correctness. We conduct a forensic analysis of batch speculative decoding and find tha…