13 papers
Mitigating Proxy-to-Wild Domain Gap in Deepfake Speech
Xuanjun Chen, Yun-Shing Wu, Wei-Chung Lu +4
Recent neural audio codec-based speech generation (CodecFake) produces highly realistic audio, posing a challenge to existing deepfake countermeasure models. While using codec resy…
CodecFake+: Codec-Based Resynthesized Data as a Proxy for Detecting CodecFake Speech
Xuanjun Chen, Jiawei Du, Haibin Wu +8
With the rapid advancement of neural audio codecs, codec-based speech generation (CoSG) systems have become highly powerful. Unfortunately, CoSG also enables the creation of highly…
Joint Fullband-Subband Modeling for High-Resolution SingFake Detection
Xuanjun Chen, Chia-Yu Hu, Sung-Feng Huang +3
Rapid advances in singing voice synthesis have increased unauthorized imitation risks, creating an urgent need for better Singing Voice Deepfake (SingFake) Detection, also known as…
How Does Instrumental Music Help SingFake Detection?
Xuanjun Chen, Chia-Yu Hu, I-Ming Lin +8
Although many models exist to detect singing voice deepfakes (SingFake), how these models operate, particularly with instrumental accompaniment, is unclear. We investigate how inst…
Stimulus Modality Matters: Impact of Perceptual Evaluations from Different Modalities on Speech Emotion Recognition System Performance
Huang-Cheng Chou, Haibin Wu, Hung-yi Lee +1
Speech Emotion Recognition (SER) systems rely on speech input and emotional labels annotated by humans. However, various emotion databases collect perceptional evaluations in diffe…
Towards Generalized Source Tracing for Codec-Based Deepfake Speech
Xuanjun Chen, I-Ming Lin, Lin Zhang +3
Recent attempts at source tracing for codec-based deepfake speech (CodecFake), generated by neural audio codec-based speech generation (CoSG) models, have exhibited suboptimal perf…