Enhancing Vector Quantization with Distributional Matching: A Theoretical and Empirical Study

Xianghong Fang, Litao Guo, Hengchao Chen +8

The success of autoregressive models largely depends on the effectiveness of vector quantization, a technique that discretizes continuous features by mapping them to the nearest co…