1 citations · 1 across the 3 of their papers we have counts for
Showing cs.AIShow all
2 papers · 1 filter
cs.AI2026
SAGE: Pushing 2-Bit Vector-Quantized LLMs toward Real-World Usability
Xianglong Yan, Zenan Wu, Kewei Zhang +2
Extreme low-bit weight-only quantization is an effective approach to reducing the deployment costs of large language models. Below 3 bits, scalar quantization often suffers severe…
cs.AI2026
JustQuant: You Don't Need Smoothing, SVD, or Rotation for 4-Bit Activation Quantization
Kaicheng Yang, Kaisen Yang, Chunyu Liu +8
Recent generative models have become increasingly powerful, but their inference cost continues to grow. Model quantization offers a promising way to compress these models and accel…