1 citations · 1 across the 7 of their papers we have counts for
5 papers · 1 filter
Tailoring the Quantization Space for 1-Bit KV Cache Compression
Minsoo Cheong, Donghyun Son, Sungjoo Yoo
The key-value (KV) cache becomes a major memory bottleneck in long-context LLM inference, placing substantial pressure on memory capacity and bandwidth. To mitigate this bottleneck…
NSNQuant: A Double Normalization Approach for Calibration-Free Low-Bit Vector Quantization of KV Cache
Donghyun Son, Euntae Choi, Sungjoo Yoo
Large Language Model (LLM) inference is typically memory-intensive, especially when processing large batch sizes and long sequences, due to the large size of key-value (KV) cache.…
Testing the Channels of Convolutional Neural Networks
Kang Choi, Donghyun Son, Younghoon Kim +1
Neural networks have complex structures, and thus it is hard to understand their inner workings and ensure correctness. To understand and debug convolutional neural networks (CNNs)…
Gradient Estimation for Unseen Domain Risk Minimization with Pre-Trained Models
Byounggyu Lew, Donghyun Son, Buru Chang
Domain generalization aims to build generalized models that perform well on unseen domains when only source domains are available for model optimization. Recent studies have shown…
Reliable Decision from Multiple Subtasks through Threshold Optimization: Content Moderation in the Wild
Donghyun Son, Byounggyu Lew, Kwanghee Choi +5
Social media platforms struggle to protect users from harmful content through content moderation. These platforms have recently leveraged machine learning models to cope with the v…