activity
20232026
most citedDifferential Transformer

13 citations · 30 across the 14 of their papers we have counts for

collaborators
Showing 2024Show all

6 papers · 1 filter

eess.AS2024

Learn from Real: Reality Defender's Submission to ASVspoof5 Challenge

Yi Zhu, Chirag Goel, Surya Koppisetti +3

Audio deepfake detection is crucial to combat the malicious use of AI-synthesized speech. Among many efforts undertaken by the community, the ASVspoof challenge has become one of t…

cs.CL2024★ 13 cited

Differential Transformer

Tianzhu Ye, Li Dong, Yuqing Xia +4

Transformer tends to overallocate attention to irrelevant context. In this work, we introduce Diff Transformer, which amplifies attention to the relevant context while canceling no…

cs.SD2024★ 3 cited

SLIM: Style-Linguistics Mismatch Model for Generalized Audio Deepfake Detection

Yi Zhu, Surya Koppisetti, Trang Tran +1

Audio deepfake detection (ADD) is crucial to combat the misuse of speech synthesized from generative AI models. Existing ADD models suffer from generalization issues, with a large…

eess.AS2024★ 3 cited

WavRx: a Disease-Agnostic, Generalizable, and Privacy-Preserving Speech Health Diagnostic Model

Yi Zhu, Tiago Falk

Speech is known to carry health-related attributes, which has emerged as a novel venue for remote and long-term health monitoring. However, existing models are usually tailored for…

eess.AS2024

UrBAN: Urban Beehive Acoustics and PheNotyping Dataset

Mahsa Abdollahi, Yi Zhu, Heitor R. Guimarães +4

In this paper, we present a multimodal dataset obtained from a honey bee colony in Montréal, Quebec, Canada, spanning the years of 2021 to 2022. This apiary comprised 10 beehives,…

cs.CL2024★ 2 cited

You Only Cache Once: Decoder-Decoder Architectures for Language Models

Yutao Sun, Li Dong, Yi Zhu +6

We introduce a decoder-decoder architecture, YOCO, for large language models, which only caches key-value pairs once. It consists of two components, i.e., a cross-decoder stacked u…