3 papers
cs.LG2026
LiftQuant: Continuous Bit-Width LLM via Dimensional Lifting and Projection
Liulu He, XuanAng Liu, Juntao Liu +8
Existing quantization methods are fundamentally limited by rigid, integer-based bit-widths (e.g., 2, 3-bit), resulting in a ``deployment gap" where Large Language Models cannot be…
cs.LG2025
BASE-Q: Bias and Asymmetric Scaling Enhanced Rotational Quantization for Large Language Models
Liulu He, Shenli Zheng, Karwei Sun +6
Rotations have become essential to state-of-the-art quantization pipelines for large language models (LLMs) by effectively smoothing outliers in weights and activations. However, f…
cs.LG2025
FBQuant: FeedBack Quantization for Large Language Models
Yijiang Liu, Hengyu Fang, Liulu He +4
Deploying Large Language Models (LLMs) on edge devices is increasingly important, as it eliminates reliance on network connections, reduces expensive API calls, and enhances user p…