Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
BARQ: Balanced Codebook Refinement for Low-Bit LLM Quantization
Chenhang Cui, Xu Xie, Linrui Xu +4
As large language models (LLMs) grow in parameter count, model storage and parameter memory traffic have become major bottlenecks to efficient deployment. Codebook-based weight qua…
cs.LG2026
CLP: Collocation-Length Prediction for Zero-Loss Adaptive Multi-Token Inference
Xuezhen Xie, Zhiqiang Zhou
Large language model inference is bottlenecked by autoregressive decoding, where each token requires a full forward pass. Multi-token prediction (MTP) offers a promising accelerati…