activity
20202026
most citedPIM Is All You Need: A CXL-Enabled GPU-Free System for Large Language Model Inference

42 citations · 45 across the 8 of their papers we have counts for

collaborators
Showing cs.LGShow all

1 paper · 1 filter

cs.LG2026

Give the Drafter a Second Chance to Guess: Parallel Reconsideration for Speculative Decoding

Hoang Anh Duy Le, Huibing Dong, Alireza Khadem +6

Speculative decoding accelerates large language model inference with a small drafter, whose per-guess acceptance rate determines the achievable speedup. Feature-level drafters shar…