3 papers
cs.CL2026
EntropyCache: Decoded Token Entropy Guided KV Caching for Diffusion Language Models
Minsoo Cheong, Donghyun Son, Woosang Lim +1
Diffusion-based large language models (dLLMs) rely on bidirectional attention, which prevents lossless KV caching and requires a full forward pass at every denoising step. Existing…
cs.DC2026
Nalar: An agent serving framework
Marco Laju, Donghyun Son, Saurabh Agarwal +4
LLM-driven agentic applications increasingly automate complex, multi-step tasks, but serving them efficiently remains challenging due to heterogeneous components, dynamic and model…
cs.CL2024
In-Context Learning with Noisy Labels
Junyong Kang, Donghyun Son, Hwanjun Song +1
In-context learning refers to the emerging ability of large language models (LLMs) to perform a target task without additional training, utilizing demonstrations of the task. Recen…