1.8k citations · 3.5k across the 130 of their papers we have counts for
135 papers
BodyFormer: Semantics-guided 3D Body Gesture Synthesis with Transformer
Kunkun Pang, Dafei Qin, Yingruo Fan +4
Automatic gesture synthesis from speech is a topic that has attracted researchers for applications in remote communication, video games and Metaverse. Learning the mapping between…
Exploring Isolated Musical Notes as Pre-training Data for Predominant Instrument Recognition in Polyphonic Music
Lifan Zhong, Erica Cooper, Junichi Yamagishi +1
With the growing amount of musical data available, automatic instrument recognition, one of the essential problems in Music Information Retrieval (MIR), is drawing more and more at…
Towards single integrated spoofing-aware speaker verification embeddings
Sung Hwan Mun, Hye-jin Shim, Hemlata Tak +12
This study aims to develop a single integrated spoofing-aware speaker verification (SASV) embeddings that satisfy two aspects. First, rejecting non-target speakers' input as well a…
Range-Based Equal Error Rate for Spoof Localization
Lin Zhang, Xin Wang, Erica Cooper +2
Spoof localization, also called segment-level detection, is a crucial task that aims to locate spoofs in partially spoofed audio. The equal error rate (EER) is widely used to measu…
Improving Generalization Ability of Countermeasures for New Mismatch Scenario by Combining Multiple Advanced Regularization Terms
Chang Zeng, Xin Wang, Xiaoxiao Miao +2
The ability of countermeasure models to generalize from seen speech synthesis methods to unseen ones has been investigated in the ASVspoof challenge. However, a new mismatch scenar…
Speaker anonymization using orthogonal Householder neural network
Xiaoxiao Miao, Xin Wang, Erica Cooper +2
Speaker anonymization aims to conceal a speaker's identity while preserving content information in speech. Current mainstream neural-network speaker anonymization systems disentang…
Investigating Range-Equalizing Bias in Mean Opinion Score Ratings of Synthesized Speech
Erica Cooper, Junichi Yamagishi
Mean Opinion Score (MOS) is a popular measure for evaluating synthesized speech. However, the scores obtained in MOS tests are heavily dependent upon many contextual factors. One s…
Cyber Vaccine for Deepfake Immunity
Ching-Chun Chang, Huy Hong Nguyen, Junichi Yamagishi +1
Deepfakes pose an evolving threat to cybersecurity, which calls for the development of automated countermeasures. While considerable forensic research has been devoted to the detec…
Hiding speaker's sex in speech using zero-evidence speaker representation in an analysis/synthesis pipeline
Paul-Gauthier Noé, Xiaoxiao Miao, Xin Wang +3
The use of modern vocoders in an analysis/synthesis pipeline allows us to investigate high-quality voice conversion that can be used for privacy purposes. Here, we propose to trans…
Can Knowledge of End-to-End Text-to-Speech Models Improve Neural MIDI-to-Audio Synthesis Systems?
Xuan Shi, Erica Cooper, Xin Wang +2
With the similarity between music and speech synthesis from symbolic input and the rapid development of text-to-speech (TTS) techniques, it is worthwhile to explore ways to improve…
Outlier-Aware Training for Improving Group Accuracy Disparities
Li-Kuang Chen, Canasai Kruengkrai, Junichi Yamagishi
Methods addressing spurious correlations such as Just Train Twice (JTT, arXiv:2107.09044v2) involve reweighting a subset of the training set to maximize the worst-group accuracy. H…
Analysis of Master Vein Attacks on Finger Vein Recognition Systems
Huy H. Nguyen, Trung-Nghia Le, Junichi Yamagishi +1
Finger vein recognition (FVR) systems have been commercially used, especially in ATMs, for customer verification. Thus, it is essential to measure their robustness against various…
Spoofed training data for speech spoofing countermeasure can be efficiently created using neural vocoders
Xin Wang, Junichi Yamagishi
A good training set for speech spoofing countermeasures requires diverse TTS and VC spoofing attacks, but generating TTS and VC spoofed trials for a target speaker may be technical…
ASVspoof 2021: Towards Spoofed and Deepfake Speech Detection in the Wild
Xuechen Liu, Xin Wang, Md Sahidullah +8
Benchmarking initiatives support the meaningful comparison of competing solutions to prominent problems in speech and language processing. Successive benchmarking evaluations typic…
Joint Speaker Encoder and Neural Back-end Model for Fully End-to-End Automatic Speaker Verification with Multiple Enrollment Utterances
Chang Zeng, Xiaoxiao Miao, Xin Wang +2
Conventional automatic speaker verification systems can usually be decomposed into a front-end model such as time delay neural network (TDNN) for extracting speaker embeddings and…
Spoofing-Aware Attention based ASV Back-end with Multiple Enrollment Utterances and a Sampling Strategy for the SASV Challenge 2022
Chang Zeng, Lin Zhang, Meng Liu +1
Current state-of-the-art automatic speaker verification (ASV) systems are vulnerable to presentation attacks, and several countermeasures (CMs), which distinguish bona fide trials…
The VoicePrivacy 2020 Challenge Evaluation Plan
Natalia Tomashenko, Brij Mohan Lal Srivastava, Xin Wang +8
The VoicePrivacy Challenge aims to promote the development of privacy preservation tools for speech technology by gathering a new community to define the tasks of interest and the…
The PartialSpoof Database and Countermeasures for the Detection of Short Fake Speech Segments Embedded in an Utterance
Lin Zhang, Xin Wang, Erica Cooper +2
Automatic speaker verification is susceptible to various manipulations and spoofing, such as text-to-speech synthesis, voice conversion, replay, tampering, adversarial attacks, and…
Analyzing Language-Independent Speaker Anonymization Framework under Unseen Conditions
Xiaoxiao Miao, Xin Wang, Erica Cooper +2
In our previous work, we proposed a language-independent speaker anonymization system based on self-supervised learning models. Although the system can anonymize speech data of any…
Joint Noise Reduction and Listening Enhancement for Full-End Speech Enhancement
Haoyu Li, Yun Liu, Junichi Yamagishi
Speech enhancement (SE) methods mainly focus on recovering clean speech from noisy input. In real-world speech communication, however, noises often exist in not only speaker but al…
Investigating Active-learning-based Training Data Selection for Speech Spoofing Countermeasure
Xin Wang, Junich Yamagishi
Training a spoofing countermeasure (CM) that generalizes to various unseen data is desired but challenging. While methods such as data augmentation and self-supervised learning are…
The VoicePrivacy 2022 Challenge Evaluation Plan
Natalia Tomashenko, Xin Wang, Xiaoxiao Miao +7
For new participants - Executive summary: (1) The task is to develop a voice anonymization system for speech data which conceals the speaker's voice identity while protecting lingu…
The VoiceMOS Challenge 2022
Wen-Chin Huang, Erica Cooper, Yu Tsao +3
We present the first edition of the VoiceMOS Challenge, a scientific event that aims to promote the study of automatic prediction of the mean opinion score (MOS) of synthetic speec…
Automatic speaker verification spoofing and deepfake detection using wav2vec 2.0 and data augmentation
Hemlata Tak, Massimiliano Todisco, Xin Wang +3
The performance of spoofing countermeasure systems depends fundamentally upon the use of sufficiently representative training data. With this usually being limited, current solutio…