activity
20232026
most citedIncorporating Ultrasound Tongue Images for Audio-Visual Speech Enhancement through Knowledge Distillation

6 citations · 6 across the 16 of their papers we have counts for

collaborators
Showing eess.ASShow all

12 papers · 1 filter

eess.AS2026

VoCodec: A Low-bitrate Streamable Neural Speech Codec with Voicing-driven Quantization

Xiao-Hang Jiang, Yang Ai, Rui-Chen Zheng +3

Neural speech codecs are key to speech transmission and storage, but most use uniform quantization across frames, allocating the same bitrate regardless of content and wasting bits…

eess.AS2026

An Ultra-Low-Bitrate Neural Speech Codec with Plain-to-Pseudo Synergistic Vector Quantization

Xiao-Hang Jiang, Yang Ai, Fei Liu +4

Most neural speech codecs use residual vector quantization (RVQ), in which later VQs contribute less but consume the same bitrate, leading to inefficiency. We propose P2PSynCodec,…

eess.AS2026

CodeSep: Low-Bitrate Codec-Driven Speech Separation with Base-Token Disentanglement and Auxiliary-Token Serial Prediction

Hui-Peng Du, Yang Ai, Xiao-Hang Jiang +2

This paper targets a new scenario that integrates speech separation with speech compression, aiming to disentangle multiple speakers while producing discrete representations for ef…

eess.AS2025

Enhancing Noise Robustness for Neural Speech Codecs through Resource-Efficient Progressive Quantization Perturbation Simulation

Rui-Chen Zheng, Yang Ai, Hui-Peng Du +1

Noise robustness remains a critical challenge for deploying neural speech codecs in real-world acoustic scenarios where background noise is often inevitable. A key observation we m…

eess.AS2025

Say More with Less: Variable-Frame-Rate Speech Tokenization via Adaptive Clustering and Implicit Duration Coding

Rui-Chen Zheng, Wenrui Liu, Hui-Peng Du +6

Existing speech tokenizers typically assign a fixed number of tokens per second, regardless of the varying information density or temporal fluctuations in the speech signal. This u…

eess.AS2025

Is GAN Necessary for Mel-Spectrogram-based Neural Vocoder?

Hui-Peng Du, Yang Ai, Rui-Chen Zheng +2

Recently, mainstream mel-spectrogram-based neural vocoders rely on generative adversarial network (GAN) for high-fidelity speech generation, e.g., HiFi-GAN and BigVGAN. However, th…