Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
NanoQuant: Efficient Sub-1-Bit Quantization of Large Language Models
Hyochan Chong, Dongkyu Kim, Changdong Kim +1
Weight-only quantization has become a standard approach for efficiently serving large language models (LLMs). However, existing methods fail to efficiently compress models to binar…
cs.LG2025
LittleBit: Ultra Low-Bit Quantization via Latent Factorization
Banseok Lee, Dongkyu Kim, Youngcheon You +1
The deployment of large language models (LLMs) is frequently hindered by prohibitive memory and computational requirements. While quantization mitigates these bottlenecks, maintain…