2 papers
cs.CL2026
Training-free Dropout Sampling for Semantic Token Acceptance in Speculative Decoding
Jeongtae Lee, Minjung Jo, Hyunjoon Jeong +5
Speculative decoding accelerates large language model inference by proposing tokens with a lightweight draft model and selectively accepting them using a target model. This work in…
cs.DC2025
Debunking the CUDA Myth Towards GPU-based AI Systems
Yunjae Lee, Juntaek Lim, Jehyeon Bang +10
This paper presents a comprehensive evaluation of Intel Gaudi NPUs as an alternative to NVIDIA GPUs, which is currently the de facto standard in AI system design. First, we create…