2 citations · 2 across the 4 of their papers we have counts for
5 papers
Designing Textual Interfaces To Enhance Llm Reasoning On Audio-Visual Question Answering
Yi Wang, Tianzi Wang, Tong Lei +2
Automatic prompt optimization (APO) has shown strong effectiveness for text-based LLMs and LLM systems, but its application to audio-visual understanding systems requires suitable…
Rethinking Discrete Speech Representation Tokens for Accent Generation
Jinzuomu Zhong, Yi Wang, Korin Richmond +1
Discrete Speech Representation Tokens (DSRTs) have become a foundational component in speech generation. While prior work has extensively studied phonetic and speaker information i…
Learning Speech Representations with Variational Predictive Coding
Sung-Lin Yeh, Peter Bell, Hao Tang
Despite being the best known objective for learning speech representations, the HuBERT objective has not been further developed and improved. We argue that it is the lack of an und…
The role of audio-visual integration in the time course of phonetic encoding in self-supervised speech models
Yi Wang, Oli Danyi Liu, Peter Bell
Human speech perception is multimodal. In natural speech, lip movements can precede corresponding voicing by a non-negligible gap of 100-300 ms, especially for specific consonants,…
Explainable Attribute-Based Speaker Verification
Xiaoliang Wu, Chau Luu, Peter Bell +1
This paper proposes a fully explainable approach to speaker verification (SV), a task that fundamentally relies on individual speaker characteristics. The opaque use of speaker att…