211 citations · 535 across the 34 of their papers we have counts for
5 papers · 1 filter
MuseTimbre: Zero-Shot Timbre Transfer by Controlling a Frozen Music Generator
Yuan-Chiao Cheng, Zhiyao Duan
Instrument timbre transfer re-voices a performance using the timbre of another instrument. Extracting the target timbre from an audio reference capture more nuances than inferring…
Phase perturbation improves channel robustness for speech spoofing countermeasures
Yongyi Zang, You Zhang, Zhiyao Duan
In this paper, we aim to address the problem of channel robustness in speech countermeasure (CM) systems, which are used to distinguish synthetic speech from human natural speech.…
Rethinking Audio-visual Synchronization for Active Speaker Detection
Abudukelimu Wuerkaixi, You Zhang, Zhiyao Duan +1
Active speaker detection (ASD) systems are important modules for analyzing multi-talker conversations. They aim to detect which speakers or none are talking in a visual scene at an…
A Novel 1D State Space for Efficient Music Rhythmic Analysis
Mojtaba Heydari, Matthew McCallum, Andreas Ehmann +1
Inferring music time structures has a broad range of applications in music production, processing and analysis. Scholars have proposed various methods to analyze different aspects…
Audiovisual Singing Voice Separation
Bochen Li, Yuxuan Wang, Zhiyao Duan
Separating a song into vocal and accompaniment components is an active research topic, and recent years witnessed an increased performance from supervised training using deep learn…