LiftQuant: Continuous Bit-Width LLM via Dimensional Lifting and Projection

Liulu He, XuanAng Liu, Juntao Liu +8

Existing quantization methods are fundamentally limited by rigid, integer-based bit-widths (e.g., 2, 3-bit), resulting in a ``deployment gap" where Large Language Models cannot be…