Unlocking Temporal Flexibility: Neural Speech Codec with Variable Frame Rate

Hanglei Zhang, Yiwei Guo, Zhihan Li +3

Most neural speech codecs achieve bitrate adjustment through intra-frame mechanisms, such as codebook dropout, at a Constant Frame Rate (CFR). However, speech segments inherently h…