Zhenhua Ling

PACodec: A Low-bitrate Neural Speech Codec with Parallel Additive Vector Quantization

Fei Liu, Yang Ai, Xiao-Hang Jiang +1

This paper proposes PACodec, a novel low-bitrate neural speech codec based on parallel additive vector quantization (PAVQ). Unlike the mainstream residual vector quantization (RVQ)…

Neural Music Enhancement with Dual Time-Frequency Spectral Representations for Prediction and Discrimination

Fei Liu, Yang Ai, Zhen-Hua Ling

Non-professional music recordings shared online often suffer from background noise and reverberation, degrading perceived quality and limiting reuse. This paper proposes DSME, a mu…

Is Semantics Enough for Speech Mean Opinion Score Prediction?

Tianyu Lan, Yufei Shi, Yang Ai +3

Mean Opinion Score (MOS) is the gold standard for evaluating synthesized speech naturalness. However, current automatic MOS predictors are dominated by self-supervised learning (SS…

Beyond WER: A Paired Acoustic Stress Test for Ambient Clinical Scribes

Xiao-Hang Jiang, Han-Jie Guo, Ying-Si Liang +4

Ambient clinical scribes increasingly combine Automatic Speech Recognition with Large Language Models to automate documentation. However, traditional metrics like Word Error Rate m…

LatentFlowSR: High-Fidelity Audio Super-Resolution via Noise-Robust Latent Flow Matching

Fei Liu, Yang Ai, Hui-Peng Du +2

Audio super-resolution aims to recover missing high-frequency details from bandwidth-limited low-resolution audio, thereby improving the naturalness and perceptual quality of the r…

Universal Discrete-Domain Speech Enhancement

Fei Liu, Yang Ai, Ye-Xin Lu +3

In real-world scenarios, speech signals are inevitably corrupted by various types of interference, making speech enhancement (SE) a critical task for robust speech processing. Howe…

Neural Speech Separation with Parallel Amplitude and Phase Spectrum Estimation

Fei Liu, Yang Ai, Zhen-Hua Ling

This paper proposes APSS, a novel neural speech separation model with parallel amplitude and phase spectrum estimation. Unlike most existing speech separation methods, the APSS dis…

Universal Preference-Score-based Pairwise Speech Quality Assessment

Yu-Fei Shi, Yang Ai, Zhen-Hua Ling

To compare the performance of two speech generation systems, one of the most effective approaches is estimating the preference score between their generated speech. This paper prop…

A Streamable Neural Audio Codec with Residual Scalar-Vector Quantization for Real-Time Communication

Xiao-Hang Jiang, Yang Ai, Rui-Chen Zheng +1

This paper proposes StreamCodec, a streamable neural audio codec designed for real-time communication. StreamCodec adopts a fully causal, symmetric encoder-decoder structure and op…

Pitch-and-Spectrum-Aware Singing Quality Assessment with Bias Correction and Model Fusion

Yu-Fei Shi, Yang Ai, Ye-Xin Lu +2

We participated in track 2 of the VoiceMOS Challenge 2024, which aimed to predict the mean opinion score (MOS) of singing samples. Our submission secured the first place among all…

DiffStyleTTS: Diffusion-based Hierarchical Prosody Modeling for Text-to-Speech with Diverse and Controllable Styles

Jiaxuan Liu, Zhaoci Liu, Yajun Hu +3

Human speech exhibits rich and flexible prosodic variations. To address the one-to-many mapping problem from text to prosody in a reasonable and flexible manner, we propose DiffSty…

ESTVocoder: An Excitation-Spectral-Transformed Neural Vocoder Conditioned on Mel Spectrogram

Xiao-Hang Jiang, Hui-Peng Du, Yang Ai +2

This paper proposes ESTVocoder, a novel excitation-spectral-transformed neural vocoder within the framework of source-filter theory. The ESTVocoder transforms the amplitude and pha…

SAMOS: A Neural MOS Prediction Model Leveraging Semantic Representations and Acoustic Features

Yu-Fei Shi, Yang Ai, Ye-Xin Lu +2

Assessing the naturalness of speech using mean opinion score (MOS) prediction models has positive implications for the automatic evaluation of speech synthesis systems. Early MOS p…

MDCTCodec: A Lightweight MDCT-based Neural Audio Codec towards High Sampling Rate and Low Bitrate Scenarios

Xiao-Hang Jiang, Yang Ai, Rui-Chen Zheng +3

In this paper, we propose MDCTCodec, an efficient lightweight end-to-end neural audio codec based on the modified discrete cosine transform (MDCT). The encoder takes the MDCT spect…

Stage-Wise and Prior-Aware Neural Speech Phase Prediction

Fei Liu, Yang Ai, Hui-Peng Du +3

This paper proposes a novel Stage-wise and Prior-aware Neural Speech Phase Prediction (SP-NSPP) model, which predicts the phase spectrum from input amplitude spectrum by two-stage…

Voice Attribute Editing with Text Prompt

Zhengyan Sheng, Yang Ai, Li-Juan Liu +2

Despite recent advancements in speech generation with text prompt providing control over speech style, voice attributes in synthesized speech remain elusive and challenging to cont…

Low-Latency Neural Speech Phase Prediction based on Parallel Estimation Architecture and Anti-Wrapping Losses for Speech Generation Tasks

Yang Ai, Zhen-Hua Ling

This paper presents a novel neural speech phase prediction model which predicts wrapped phase spectra directly from amplitude spectra. The proposed model is a cascade of a residual…