4 papers
A Unified Rate-Distortion Perspective on Vector, Product, and Scalar Quantization
Xianghong Fang, Wenlong Mou, Yuan Yuan +2
Discrete visual tokenization, predominantly driven by vector, scalar, and product quantization, lacks a unified conceptual framework for understanding quantization tradeoffs. In th…
VQ-Transplant: Efficient VQ-Module Integration for Pre-trained Visual Tokenizers
Xianghong Fang, Yuan Yuan, Dehan Kong +1
Vector Quantization (VQ) underpins modern discrete visual tokenization. However, training quantization modules for state-of-the-art VQ-based models requires significant computation…
Distributional Matching for Vector Quantization: A Unified Theoretical and Empirical Framework
Xianghong Fang, Litao Guo, Hengchao Chen +8
The effectiveness of modern visual representation learning and autoregressive models critically depends on vector quantization (VQ), which discretizes continuous feature representa…
Enhancing Vector Quantization with Distributional Matching: A Theoretical and Empirical Study
Xianghong Fang, Litao Guo, Hengchao Chen +8
The success of autoregressive models largely depends on the effectiveness of vector quantization, a technique that discretizes continuous features by mapping them to the nearest co…