ReLMCodec: Designing Predictable Speech Tokens from Pre-Quantization Phoneme Structure

Zixiang Wan, Xusheng Yang, Zheng Wang +1

Neural speech codecs face a fundamental tension in the language-model era: tokens that support high-fidelity reconstruction are not necessarily easy for autoregressive models to pr…