128 citations · 382 across the 72 of their papers we have counts for
17 papers · 1 filter
Cross-Lingual F5-TTS 2: A Simplified Framework for Language-Agnostic Voice Cloning
Qingyu Liu, Rixi Xu, Yushen Chen +11
Zero-shot text-to-speech (TTS) can clone a speaker's voice from a short audio prompt, yet most TTS systems still require the audio prompt transcript during inference. This dependen…
Robust Cross-Domain Speech-Based Alzheimer's Disease Detection via Iterative Adversarial Self-Training
Luqi Sun, Shreeram Suresh Chandra, Aurosweta Mahapatra +3
As Alzheimer's disease (AD) has increasingly become a major global public health issue, speech-based AD detection has attracted widespread attention. However, most existing methods…
Beyond Accuracy: ARIA-Rubrics for Evaluating Audio Reasoning in Large Audio Language Models
Yupei Li, Qiyang Sun, Mohamed Mady +4
Large Audio Language Models (LALMs) have shown strong performance on audio reasoning benchmarks, but accuracy alone cannot distinguish true reasoning from superficial pattern match…
Perceptible or Not? Diagnosing Passive Fingerprints for Speech Deepfake Attribution
Yupei Li, Qiyang Sun, Emmanouil Benetos +2
Passive fingerprints (intrinsic traces naturally left by generators) have been shown to enable attribution in speech deepfake detection, yet their persistence, reproducibility, and…
Cleaner Speech, Weaker Generalization: Revisiting Pitt-Derived Benchmarks for Alzheimer's Disease Detection
Luqi Sun, Shreeram Suresh Chandra, Lin Zhang +5
Speech-based Alzheimer's disease (AD) detection increasingly relies on speech-enhanced and curated versions of the Pitt Corpus, where speech enhancement, sample selection, and demo…
Is Prosody Lost in Translation? Fine-Grained Cross-Lingual Prosody Similarity Across Languages
Haopeng Xie, Ismail Rasim Ulgen, Sofia Son +2
Prosody plays an important role in speech translation, conveying information such as emphasis, emotion, and intent beyond lexical content. However, despite recent progress in expre…
X-Voice: Enabling Everyone to Speak 30 Languages via Zero-Shot Cross-Lingual Voice Cloning
Rixi Xu, Qingyu Liu, Haitao Li +10
In this paper, we present X-Voice, a 0.4B multilingual zero-shot voice cloning model that clones arbitrary voices and enables everyone to speak 30 languages. X-Voice is trained on…
emoDARTS: Joint Optimisation of CNN & Sequential Neural Network Architectures for Superior Speech Emotion Recognition
Thejan Rajapakshe, Rajib Rana, Sara Khalifa +3
Speech Emotion Recognition (SER) is crucial for enabling computers to understand the emotions conveyed in human communication. With recent advancements in Deep Learning (DL), the p…
Enhancing Speech Emotion Recognition Through Differentiable Architecture Search
Thejan Rajapakshe, Rajib Rana, Sara Khalifa +2
Speech Emotion Recognition (SER) is a critical enabler of emotion-aware communication in human-computer interactions. Recent advancements in Deep Learning (DL) have substantially e…
Controllable Accented Text-to-Speech Synthesis
Rui Liu, Berrak Sisman, Guanglai Gao +1
Accented text-to-speech (TTS) synthesis seeks to generate speech with an accent (L2) as a variant of the standard version (L1). Accented TTS synthesis is challenging as L2 is diffe…
Accurate Emotion Strength Assessment for Seen and Unseen Speech Based on Data-Driven Deep Learning
Rui Liu, Berrak Sisman, Björn Schuller +2
Emotion classification of speech and assessment of the emotion strength are required in applications such as emotional text-to-speech and voice conversion. The emotion attribute ra…
Emotion Intensity and its Control for Emotional Voice Conversion
Kun Zhou, Berrak Sisman, Rajib Rana +2
Emotional voice conversion (EVC) seeks to convert the emotional state of an utterance while preserving the linguistic content and speaker identity. In EVC, emotions are usually tre…
StrengthNet: Deep Learning-based Emotion Strength Assessment for Emotional Speech Synthesis
Rui Liu, Berrak Sisman, Haizhou Li
Recently, emotional speech synthesis has achieved remarkable performance. The emotion strength of synthesized speech can be controlled flexibly using a strength descriptor, which i…
VAW-GAN for Disentanglement and Recomposition of Emotional Elements in Speech
Kun Zhou, Berrak Sisman, Haizhou Li
Emotional voice conversion (EVC) aims to convert the emotion of speech from one state to another while preserving the linguistic content and speaker identity. In this paper, we stu…
Seen and Unseen emotional style transfer for voice conversion with a new emotional speech dataset
Kun Zhou, Berrak Sisman, Rui Liu +1
Emotional voice conversion aims to transform emotional prosody in speech while preserving the linguistic content and speaker identity. Prior studies show that it is possible to dis…
Expressive TTS Training with Frame and Style Reconstruction Loss
Rui Liu, Berrak Sisman, Guanglai Gao +1
We propose a novel training strategy for Tacotron-based text-to-speech (TTS) system to improve the expressiveness of speech. One of the key challenges in prosody modeling is the la…
Converting Anyone's Emotion: Towards Speaker-Independent Emotional Voice Conversion
Kun Zhou, Berrak Sisman, Mingyang Zhang +1
Emotional voice conversion aims to convert the emotion of speech from one state to another while preserving the linguistic content and speaker identity. The prior studies on emotio…