85 citations · 632 across the 65 of their papers we have counts for
65 papers
Audio Deepfake Detection: A Survey
Jiangyan Yi, Chenglong Wang, Jianhua Tao +3
Audio deepfake detection is an emerging active topic. A growing number of literatures have aimed to study deepfake detection algorithms and achieved effective performance, the prob…
Do You Remember? Overcoming Catastrophic Forgetting for Fake Audio Detection
Xiaohui Zhang, Jiangyan Yi, Jianhua Tao +2
Current fake audio detection algorithms have achieved promising performances on most datasets. However, their performance may be significantly degraded when dealing with audio of a…
Spatial Reconstructed Local Attention Res2Net with F0 Subband for Fake Speech Detection
Cunhang Fan, Jun Xue, Jianhua Tao +4
The rhythm of bonafide speech is often difficult to replicate, which causes that the fundamental frequency (F0) of synthetic speech is significantly different from that of real spe…
TST: Time-Sparse Transducer for Automatic Speech Recognition
Xiaohui Zhang, Mangui Liang, Zhengkun Tian +2
End-to-end model, especially Recurrent Neural Network Transducer (RNN-T), has achieved great success in speech recognition. However, transducer requires a great memory footprint an…
Boosting Fast and High-Quality Speech Synthesis with Linear Diffusion
Haogeng Liu, Tao Wang, Jie Cao +2
Denoising Diffusion Probabilistic Models have shown extraordinary ability on various generative tasks. However, their slow inference speed renders them impractical in speech synthe…
Low-rank Adaptation Method for Wav2vec2-based Fake Audio Detection
Chenglong Wang, Jiangyan Yi, Xiaohui Zhang +3
Self-supervised speech models are a rapidly developing research topic in fake audio detection. Many pre-trained models can serve as feature extractors, learning richer and higher-l…
Adaptive Fake Audio Detection with Low-Rank Model Squeezing
Xiaohui Zhang, Jiangyan Yi, Jianhua Tao +3
The rapid advancement of spoofing algorithms necessitates the development of robust detection methods capable of accurately identifying emerging fake audio. Traditional approaches,…
TO-Rawnet: Improving RawNet with TCN and Orthogonal Regularization for Fake Audio Detection
Chenglong Wang, Jiangyan Yi, Jianhua Tao +4
Current fake audio detection relies on hand-crafted features, which lose information during extraction. To overcome this, recent studies use direct feature extraction from raw audi…
Detection of Cross-Dataset Fake Audio Based on Prosodic and Pronunciation Features
Chenglong Wang, Jiangyan Yi, Jianhua Tao +3
Existing fake audio detection systems perform well in in-domain testing, but still face many challenges in out-of-domain testing. This is due to the mismatch between the training a…
M2-CTTS: End-to-End Multi-scale Multi-modal Conversational Text-to-Speech Synthesis
Jinlong Xue, Yayue Deng, Fengping Wang +5
Conversational text-to-speech (TTS) aims to synthesize speech with proper prosody of reply based on the historical conversation. However, it is still a challenge to comprehensively…
UnifySpeech: A Unified Framework for Zero-shot Text-to-Speech and Voice Conversion
Haogeng Liu, Tao Wang, Ruibo Fu +3
Text-to-speech (TTS) and voice conversion (VC) are two different tasks both aiming at generating high quality speaking voice according to different input modality. Due to their sim…
Emotion Selectable End-to-End Text-based Speech Editing
Tao Wang, Jiangyan Yi, Ruibo Fu +3
Text-based speech editing allows users to edit speech by intuitively cutting, copying, and pasting text to speed up the process of editing speech. In the previous work, CampNet (co…
SceneFake: An Initial Dataset and Benchmarks for Scene Fake Audio Detection
Jiangyan Yi, Chenglong Wang, Jianhua Tao +5
Many datasets have been designed to further the development of fake audio detection. However, fake utterances in previous datasets are mostly generated by altering timbre, prosody,…
EmoFake: An Initial Dataset for Emotion Fake Audio Detection
Yan Zhao, Jiangyan Yi, Jianhua Tao +3
Many datasets have been designed to further the development of fake audio detection, such as datasets of the ASVspoof and ADD challenges. However, these datasets do not consider a…
Text Enhancement for Paragraph Processing in End-to-End Code-switching TTS
Chunyu Qiang, Jianhua Tao, Ruibo Fu +4
Current end-to-end code-switching Text-to-Speech (TTS) can already generate high quality two languages speech in the same utterance with single speaker bilingual corpora. When the…
An Initial Investigation for Detecting Vocoder Fingerprints of Fake Audio
Xinrui Yan, Jiangyan Yi, Jianhua Tao +5
Many effective attempts have been made for fake audio detection. However, they can only provide detection results but no countermeasures to curb this harm. For many related practic…
Fully Automated End-to-End Fake Audio Detection
Chenglong Wang, Jiangyan Yi, Jianhua Tao +6
The existing fake audio detection systems often rely on expert experience to design the acoustic features or manually design the hyperparameters of the network structure. However,…
Audio Deepfake Detection Based on a Combination of F0 Information and Real Plus Imaginary Spectrogram Features
Jun Xue, Cunhang Fan, Zhao Lv +6
Recently, pioneer research works have proposed a large number of acoustic features (log power spectrogram, linear frequency cepstral coefficients, constant Q cepstral coefficients,…
Audio Deepfake Attribution: An Initial Dataset and Investigation
Xinrui Yan, Jiangyan Yi, Jianhua Tao +1
The rapid progress of deep speech synthesis models has posed significant threats to society such as malicious manipulation of content. This has led to an increase in studies aimed…
CFAD: A Chinese Dataset for Fake Audio Detection
Haoxin Ma, Jiangyan Yi, Chenglong Wang +5
Fake audio detection is a growing concern and some relevant datasets have been designed for research. However, there is no standard public Chinese dataset under complex conditions.…
CampNet: Context-Aware Mask Prediction for End-to-End Text-Based Speech Editing
Tao Wang, Jiangyan Yi, Ruibo Fu +2
The text-based speech editor allows the editing of speech through intuitive cutting, copying, and pasting operations to speed up the process of editing speech. However, the major d…
NeuralDPS: Neural Deterministic Plus Stochastic Model with Multiband Excitation for Noise-Controllable Waveform Generation
Tao Wang, Ruibo Fu, Jiangyan Yi +2
The traditional vocoders have the advantages of high synthesis efficiency, strong interpretability, and speech editability, while the neural vocoders have the advantage of high syn…
GCNet: Graph Completion Network for Incomplete Multimodal Learning in Conversation
Zheng Lian, Lan Chen, Licai Sun +2
Conversations have become a critical data format on social media platforms. Understanding conversation from emotion, content and other aspects also attracts increasing attention fr…
MixKG: Mixing for harder negative samples in knowledge graph
Feihu Che, Guohua Yang, Pengpeng Shao +2
Knowledge graph embedding~(KGE) aims to represent entities and relations into low-dimensional vectors for many real-world applications. The representations of entities and relation…