activity
20242026
most citedHierarchical Emotion Prediction and Control in Text-to-Speech Synthesis

16 citations · 27 across the 21 of their papers we have counts for

collaborators
Showing 2024Show all

9 papers · 1 filter

cs.SD2024

Hierarchical Control of Emotion Rendering in Speech Synthesis

Sho Inoue, Kun Zhou, Shuai Wang +1

Emotional text-to-speech synthesis (TTS) aims to generate realistic emotional speech from input text. However, quantitatively controlling multi-level emotion rendering remains chal…

cs.SD2024★ 11 cited

Speech Separation with Pretrained Frontend to Minimize Domain Mismatch

Wupeng Wang, Zexu Pan, Xinke Li +2

Speech separation seeks to separate individual speech signals from a speech mixture. Typically, most separation models are trained on synthetic data due to the unavailability of ta…

eess.AS2024

M-Vec: Matryoshka Speaker Embeddings with Flexible Dimensions

Shuai Wang, Pengcheng Zhu, Haizhou Li

Fixed-dimensional speaker embeddings have become the dominant approach in speaker modeling, typically spanning hundreds to thousands of dimensions. These dimensions are hyperparame…

cs.SD2024

On the effectiveness of enrollment speech augmentation for Target Speaker Extraction

Junjie Li, Ke Zhang, Shuai Wang +3

Deep learning technologies have significantly advanced the performance of target speaker extraction (TSE) tasks. To enhance the generalization and robustness of these algorithms wh…

eess.AS2024

E1 TTS: Simple and Fast Non-Autoregressive TTS

Zhijun Liu, Shuai Wang, Pengcheng Zhu +2

This paper introduces Easy One-Step Text-to-Speech (E1 TTS), an efficient non-autoregressive zero-shot text-to-speech system based on denoising diffusion pretraining and distributi…

cs.SD2024

MacST: Multi-Accent Speech Synthesis via Text Transliteration for Accent Conversion

Sho Inoue, Shuai Wang, Wanxing Wang +3

In accented voice conversion or accent conversion, we seek to convert the accent in speech from one another while preserving speaker identity and semantic content. In this study, w…

eess.AS2024

Autoregressive Diffusion Transformer for Text-to-Speech Synthesis

Zhijun Liu, Shuai Wang, Sho Inoue +2

Audio language models have recently emerged as a promising approach for various audio generation tasks, relying on audio tokenizers to encode waveforms into sequences of discrete s…

cs.SD2024★ 16 cited

Hierarchical Emotion Prediction and Control in Text-to-Speech Synthesis

Sho Inoue, Kun Zhou, Shuai Wang +1

It remains a challenge to effectively control the emotion rendering in text-to-speech (TTS) synthesis. Prior studies have primarily focused on learning a global prosodic representa…

cs.SD2024

Fine-Grained Quantitative Emotion Editing for Speech Generation

Sho Inoue, Kun Zhou, Shuai Wang +1

It remains a significant challenge how to quantitatively control the expressiveness of speech emotion in speech generation. In this work, we present a novel approach for manipulati…