1 citations · 1 across the 7 of their papers we have counts for
9 papers
Tailoring the Quantization Space for 1-Bit KV Cache Compression
Minsoo Cheong, Donghyun Son, Sungjoo Yoo
The key-value (KV) cache becomes a major memory bottleneck in long-context LLM inference, placing substantial pressure on memory capacity and bandwidth. To mitigate this bottleneck…
K-EXAONE 2.0 Technical Report
Eunbi Choi, Kibong Choi, Sehyun Chun +74
This technical report presents K-EXAONE 2.0, an open-weight multilingual foundation model developed by LG AI Research as a step in our effort toward global frontier-scale foundatio…
EntropyCache: Decoded Token Entropy Guided KV Caching for Diffusion Language Models
Minsoo Cheong, Donghyun Son, Woosang Lim +1
Diffusion-based large language models (dLLMs) rely on bidirectional attention, which prevents lossless KV caching and requires a full forward pass at every denoising step. Existing…
Nalar: Workflow-Aware Management of Agentic Applications
Marco Laju, Donghyun Son, Saurabh Agarwal +4
LLM-driven agentic applications automate complex, multi-step tasks, but serving them efficiently remains difficult due to heterogeneous components, dynamic model-driven control flo…
NSNQuant: A Double Normalization Approach for Calibration-Free Low-Bit Vector Quantization of KV Cache
Donghyun Son, Euntae Choi, Sungjoo Yoo
Large Language Model (LLM) inference is typically memory-intensive, especially when processing large batch sizes and long sequences, due to the large size of key-value (KV) cache.…
In-Context Learning with Noisy Labels
Junyong Kang, Donghyun Son, Hwanjun Song +1
In-context learning refers to the emerging ability of large language models (LLMs) to perform a target task without additional training, utilizing demonstrations of the task. Recen…
Testing the Channels of Convolutional Neural Networks
Kang Choi, Donghyun Son, Younghoon Kim +1
Neural networks have complex structures, and thus it is hard to understand their inner workings and ensure correctness. To understand and debug convolutional neural networks (CNNs)…
Gradient Estimation for Unseen Domain Risk Minimization with Pre-Trained Models
Byounggyu Lew, Donghyun Son, Buru Chang
Domain generalization aims to build generalized models that perform well on unseen domains when only source domains are available for model optimization. Recent studies have shown…
Reliable Decision from Multiple Subtasks through Threshold Optimization: Content Moderation in the Wild
Donghyun Son, Byounggyu Lew, Kwanghee Choi +5
Social media platforms struggle to protect users from harmful content through content moderation. These platforms have recently leveraged machine learning models to cope with the v…