13 papers
Improved Monitoring of Honey bee Colony Strength via Audio IoT Sensors, Modulation Tensorgrams and Recurrent Neural Networks
Mahsa Abdollahi, Yi Zhu, Heitor R. Guimarães +4
Honey bees (Apis mellifera) play a crucial role in agriculture and ecosystem stability as key pollinators of crops and wild plants. As such, monitoring hive strength remotely with…
AUDDT: A Unified Benchmark Toolkit for Audio and Speech Deepfake Detectors
Yi Zhu, Heitor R. Guimarães, Arthur Pimentel +1
With the prevalence of artificial intelligence (AI)-generated content, such as audio deepfakes, a large body of recent work has focused on developing deepfake detection techniques.…
Alethia: A Foundational Encoder for Voice Deepfakes
Yi Zhu, Brahmi Dwivedi, Jayaram Raghuram +1
Existing voice deepfake detection and localization models rely heavily on representations extracted from speech foundation models (SFMs). However, downstream finetuning has now rea…
ICLAD: In-Context Learning with Comparison-Guidance for Audio Deepfake Detection
Benjamin Chou, Yi Zhu, Surya Koppisetti
Audio deepfakes pose a significant security threat, yet current state-of-the-art (SOTA) detection systems do not generalize well to realistic in-the-wild deepfakes. We introduce a…
VIBEVOICE-ASR Technical Report
Zhiliang Peng, Jianwei Yu, Yaoyao Chang +21
This report presents VibeVoice-ASR, a general-purpose speech understanding framework built upon VibeVoice, designed to address the persistent challenges of context fragmentation an…
VibeVoice Technical Report
Zhiliang Peng, Jianwei Yu, Wenhui Wang +10
This report presents VibeVoice, a novel model designed to synthesize long-form speech with multiple speakers by employing next-token diffusion, which is a unified method for modeli…