DiVeQ: Differentiable Vector Quantization Using the Reparameterization Trick

Mohammad Hassan Vali, Tom Bäckström, Arno Solin

Vector quantization is common in deep models, yet its hard assignments block gradients and hinder end-to-end training. We propose DiVeQ, which treats quantization as adding an erro…