53 citations · 111 across the 62 of their papers we have counts for
23 papers · 1 filter
MSM-VC: High-fidelity Source Style Transfer for Non-Parallel Voice Conversion by Multi-scale Style Modeling
Zhichao Wang, Xinsheng Wang, Qicong Xie +4
In addition to conveying the linguistic content from source speech to converted speech, maintaining the speaking style of source speech also plays an important role in the voice co…
DualVC 2: Dynamic Masked Convolution for Unified Streaming and Non-Streaming Voice Conversion
Ziqian Ning, Yuepeng Jiang, Pengcheng Zhu +4
Voice conversion is becoming increasingly popular, and a growing number of application scenarios require models with streaming inference capabilities. The recently proposed DualVC…
PromptVC: Flexible Stylistic Voice Conversion in Latent Space Driven by Natural Language Prompts
Jixun Yao, Yuguang Yang, Yi Lei +7
Style voice conversion aims to transform the style of source speech to a desired style according to real-world application demands. However, the current style voice conversion appr…
METTS: Multilingual Emotional Text-to-Speech by Cross-speaker and Cross-lingual Emotion Transfer
Xinfa Zhu, Yi Lei, Tao Li +4
Previous multilingual text-to-speech (TTS) approaches have considered leveraging monolingual speaker data to enable cross-lingual speech synthesis. However, such data-efficient app…
DCCRN-KWS: an audio bias based model for noise robust small-footprint keyword spotting
Shubo Lv, Xiong Wang, Sining Sun +2
Real-world complex acoustic environments especially the ones with a low signal-to-noise ratio (SNR) will bring tremendous challenges to a keyword spotting (KWS) system. Inspired by…
LM-VC: Zero-shot Voice Conversion via Speech Generation based on Language Models
Zhichao Wang, Yuanzhe Chen, Lei Xie +2
Language model (LM) based audio generation frameworks, e.g., AudioLM, have recently achieved new state-of-the-art performance in zero-shot audio generation. In this paper, we explo…
DualVC: Dual-mode Voice Conversion using Intra-model Knowledge Distillation and Hybrid Predictive Coding
Ziqian Ning, Yuepeng Jiang, Pengcheng Zhu +4
Voice conversion is an increasingly popular technology, and the growing number of real-time applications requires models with streaming conversion capabilities. Unlike typical (non…
TranUSR: Phoneme-to-word Transcoder Based Unified Speech Representation Learning for Cross-lingual Speech Recognition
Hongfei Xue, Qijie Shao, Peikun Chen +3
UniSpeech has achieved superior performance in cross-lingual automatic speech recognition (ASR) by explicitly aligning latent representations to phoneme units using multi-task self…
Contextualized End-to-End Speech Recognition with Contextual Phrase Prediction Network
Kaixun Huang, Ao Zhang, Zhanheng Yang +4
Contextual information plays a crucial role in speech recognition technologies and incorporating it into the end-to-end speech recognition models has drawn immense interest recentl…
Multi-level Temporal-channel Speaker Retrieval for Zero-shot Voice Conversion
Zhichao Wang, Liumeng Xue, Qiuqiang Kong +4
Zero-shot voice conversion (VC) converts source speech into the voice of any desired speaker using only one utterance of the speaker without requiring additional model updates. Typ…
The NPU-Elevoc Personalized Speech Enhancement System for ICASSP2023 DNS Challenge
Xiaopeng Yan, Yindi Yang, Zhihao Guo +2
This paper describes our NPU-Elevoc personalized speech enhancement system (NAPSE) for the 5th Deep Noise Suppression Challenge at ICASSP 2023. Based on the superior two-stage mode…
Two-stage Neural Network for ICASSP 2023 Speech Signal Improvement Challenge
Mingshuai Liu, Shubo Lv, Zihan Zhang +6
In ICASSP 2023 speech signal improvement challenge, we developed a dual-stage neural model which improves speech signal quality induced by different distortions in a stage-wise div…
Two-step Band-split Neural Network Approach for Full-band Residual Echo Suppression
Zihan Zhang, Shimin Zhang, Mingshuai Liu +4
This paper describes a Two-step Band-split Neural Network (TBNN) approach for full-band acoustic echo cancellation. Specifically, after linear filtering, we split the full-band sig…
MSV Challenge 2022: NPU-HC Speaker Verification System for Low-resource Indian Languages
Yue Li, Li Zhang, Namin Wang +2
This report describes the NPU-HC speaker verification system submitted to the O-COCOSDA Multi-lingual Speaker Verification (MSV) Challenge 2022, which focuses on developing speaker…
Expressive-VC: Highly Expressive Voice Conversion with Attention Fusion of Bottleneck and Perturbation Features
Ziqian Ning, Qicong Xie, Pengcheng Zhu +5
Voice conversion for highly expressive speech is challenging. Current approaches struggle with the balancing between speaker similarity, intelligibility and expressiveness. To addr…
Distinguishable Speaker Anonymization based on Formant and Fundamental Frequency Scaling
Jixun Yao, Qing Wang, Yi Lei +4
Speech data on the Internet are proliferating exponentially because of the emergence of social media, and the sharing of such personal data raises obvious security and privacy conc…
Preserving background sound in noise-robust voice conversion via multi-task learning
Jixun Yao, Yi Lei, Qing Wang +6
Background sound is an informative form of art that is helpful in providing a more immersive experience in real-application voice conversion (VC) scenarios. However, prior research…
Multi-Speaker Expressive Speech Synthesis via Multiple Factors Decoupling
Xinfa Zhu, Yi Lei, Kun Song +3
This paper aims to synthesize the target speaker's speech with desired speaking style and emotion by transferring the style and emotion from reference speech recorded by other spea…
Delivering Speaking Style in Low-resource Voice Conversion with Multi-factor Constraints
Zhichao Wang, Xinsheng Wang, Lei Xie +3
Conveying the linguistic content and maintaining the source speech's speaking style, such as intonation and emotion, is essential in voice conversion (VC). However, in a low-resour…
WeKws: A production first small-footprint end-to-end Keyword Spotting Toolkit
Jie Wang, Menglong Xu, Jingyong Hou +4
Keyword spotting (KWS) enables speech-based user interaction and gradually becomes an indispensable component of smart devices. Recently, end-to-end (E2E) methods have become the m…
spatial-dccrn: dccrn equipped with frame-level angle feature and hybrid filtering for multi-channel speech enhancement
Shubo Lv, Yihui Fu, Yukai Jv +4
Recently, multi-channel speech enhancement has drawn much interest due to the use of spatial information to distinguish target speech from interfering signal. To make full use of s…
NWPU-ASLP System for the VoicePrivacy 2022 Challenge
Jixun Yao, Qing Wang, Li Zhang +3
This paper presents the NWPU-ASLP speaker anonymization system for VoicePrivacy 2022 Challenge. Our submission does not involve additional Automatic Speaker Verification (ASV) mode…
End-to-End Voice Conversion with Information Perturbation
Qicong Xie, Shan Yang, Yi Lei +2
The ideal goal of voice conversion is to convert the source speaker's speech to sound naturally like the target speaker while maintaining the linguistic content and the prosody of…