Representation Collapsing Problems in Vector Quantization

Wenhao Zhao, Qiran Zou, Rushi Shah +1

Vector quantization is a technique in machine learning that discretizes continuous representations into a set of discrete vectors. It is widely employed in tokenizing data represen…