211 citations · 382 across the 17 of their papers we have counts for
17 papers
Towards Perception-Informed Latent HRTF Representations
You Zhang, Andrew Francl, Ruohan Gao +3
Personalized head-related transfer functions (HRTFs) are essential for ensuring a realistic auditory experience over headphones, because they take into account individual anatomica…
PartialEdit: Identifying Partial Deepfakes in the Era of Neural Speech Editing
You Zhang, Baotong Tian, Lin Zhang +1
Neural speech editing enables seamless partial edits to speech utterances, allowing modifications to selected content while preserving the rest of the audio unchanged. This useful…
Audio Visual Segmentation Through Text Embeddings
Kyungbok Lee, You Zhang, Zhiyao Duan
The goal of Audio-Visual Segmentation (AVS) is to localize and segment the sounding source objects from video frames. Research on AVS suffers from data scarcity due to the high cos…
A Multi-Stream Fusion Approach with One-Class Learning for Audio-Visual Deepfake Detection
Kyungbok Lee, You Zhang, Zhiyao Duan
This paper addresses the challenge of developing a robust audio-visual deepfake detection model. In practical use cases, new generation algorithms are continually emerging, and the…
Learning Arousal-Valence Representation from Categorical Emotion Labels of Speech
Enting Zhou, You Zhang, Zhiyao Duan
Dimensional representations of speech emotions such as the arousal-valence (AV) representation provide a continuous and fine-grained description and control than their categorical…
SingFake: Singing Voice Deepfake Detection
Yongyi Zang, You Zhang, Mojtaba Heydari +1
The rise of singing voice synthesis presents critical challenges to artists and industry stakeholders over unauthorized voice usage. Unlike synthesized speech, synthesized singing…
Mitigating Cross-Database Differences for Learning Unified HRTF Representation
Yutong Wen, You Zhang, Zhiyao Duan
Individualized head-related transfer functions (HRTFs) are crucial for accurate sound positioning in virtual auditory displays. As the acoustic measurement of HRTFs is resource-int…
Phase perturbation improves channel robustness for speech spoofing countermeasures
Yongyi Zang, You Zhang, Zhiyao Duan
In this paper, we aim to address the problem of channel robustness in speech countermeasure (CM) systems, which are used to distinguish synthetic speech from human natural speech.…
SAMO: Speaker Attractor Multi-Center One-Class Learning for Voice Anti-Spoofing
Siwen Ding, You Zhang, Zhiyao Duan
Voice anti-spoofing systems are crucial auxiliaries for automatic speaker verification (ASV) systems. A major challenge is caused by unseen attacks empowered by advanced speech syn…
HRTF Field: Unifying Measured HRTF Magnitude Representation with Neural Fields
You Zhang, Yuxiang Wang, Zhiyao Duan
Head-related transfer functions (HRTFs) are a set of functions describing the spatial filtering effect of the outer ear (i.e., torso, head, and pinnae) onto sound sources at differ…
Rethinking Audio-visual Synchronization for Active Speaker Detection
Abudukelimu Wuerkaixi, You Zhang, Zhiyao Duan +1
Active speaker detection (ASD) systems are important modules for analyzing multi-talker conversations. They aim to detect which speakers or none are talking in a visual scene at an…
Predicting Global HRTFs From Scanned Head Geometry Using Deep Learning and Compact Representations
Yuxiang Wang, You Zhang, Zhiyao Duan +1
In the growing field of virtual auditory display, personalized head-related transfer functions (HRTFs) play a vital role in establishing an accurate sound image for mixed and augme…
A Probabilistic Fusion Framework for Spoofing Aware Speaker Verification
You Zhang, Ge Zhu, Zhiyao Duan
The performance of automatic speaker verification (ASV) systems could be degraded by voice spoofing attacks. Most existing works aimed to develop standalone spoofing countermeasure…
UR Channel-Robust Synthetic Speech Detection System for ASVspoof 2021
Xinhui Chen, You Zhang, Ge Zhu +1
In this paper, we present UR-AIR system submission to the logical access (LA) and the speech deepfake (DF) tracks of the ASVspoof 2021 Challenge. The LA and DF tasks focus on synth…
An Empirical Study on Channel Effects for Synthetic Voice Spoofing Countermeasure Systems
You Zhang, Ge Zhu, Fei Jiang +1
Spoofing countermeasure (CM) systems are critical in speaker verification; they aim to discern spoofing attacks from bona fide speech trials. In practice, however, acoustic conditi…
One-class Learning Towards Synthetic Voice Spoofing Detection
You Zhang, Fei Jiang, Zhiyao Duan
Human voices can be used to authenticate the identity of the speaker, but the automatic speaker verification (ASV) systems are vulnerable to voice spoofing attacks, such as imperso…
Speech Driven Talking Face Generation from a Single Image and an Emotion Condition
Sefik Emre Eskimez, You Zhang, Zhiyao Duan
Visual emotion expression plays an important role in audiovisual speech communication. In this work, we propose a novel approach to rendering visual emotion expression in speech-dr…