AUV: Teaching Audio Universal Vector Quantization with Single Nested Codebook

Yushen Chen, Kai Hu, Long Zhou +4

We propose AUV, a unified neural audio codec with a single codebook, which enables a favourable reconstruction of speech and further extends to general audio, including vocal, musi…