6 papers · 1 filter
TS-SP: Learning Speaker-Preserving Representations in Audio Large Language Models
Junjie Li, Zheng Liang, Zhe Li +2
Audio large language models (ALLMs) can understand speech content, yet their ability to use speaker identity for verification remains limited. We propose TS-SP (Two-Stage Speaker P…
WeDefense: A Toolkit to Defend Against Fake Audio
Lin Zhang, Johan Rohdin, Xin Wang +8
The advances in generative AI have enabled the creation of synthetic audio which is perceptually indistinguishable from real, genuine audio. Although this stellar progress enables…
Addressing Gradient Misalignment in Data-Augmented Training for Robust Speech Deepfake Detection
Duc-Tuan Truong, Tianchi Liu, Junjie Li +3
In speech deepfake detection (SDD), data augmentation (DA) is commonly used to improve model generalization across varied speech conditions and spoofing attacks. However, during tr…
QAMO: Quality-aware Multi-centroid One-class Learning For Speech Deepfake Detection
Duc-Tuan Truong, Tianchi Liu, Ruijie Tao +3
Recent work shows that one-class learning can detect unseen deepfake attacks by modeling a compact distribution of bona fide speech around a single centroid. However, the single-ce…
Xi+: Uncertainty Supervision for Robust Speaker Embedding
Junjie Li, Kong Aik Lee, Duc-Tuan Truong +2
There are various factors that can influence the performance of speaker recognition systems, such as emotion, language and other speaker-related or context-related variations. Sinc…
Audio-FLAN: An Instruction-Following Dataset for Unified Audio Understanding and Generation of Speech, Music, and Sound
Liumeng Xue, Ziya Zhou, Jiahao Pan +20
Recent advancements in audio tokenization have significantly enhanced the integration of audio capabilities into large language models (LLMs). However, audio understanding and gene…