4 papers
Speech-to-See: End-to-End Speech-Driven Open-Set Object Detection
Wenhuan Lu, Xinyue Song, Wenjun Ke +3
Audio grounding, or speech-driven open-set object detection, aims to localize and identify objects directly from speech, enabling generalization beyond predefined categories. This…
Listening for "You": Enhancing Speech Image Retrieval via Target Speaker Extraction
Wenhao Yang, Jianguo Wei, Wenhuan Lu +2
Image retrieval using spoken language cues has emerged as a promising direction in multimodal perception, yet leveraging speech in multi-speaker scenarios remains challenging. We p…
Channel Adaptation for Speaker Verification Using Optimal Transport with Pseudo Label
Wenhao Yang, Jianguo Wei, Wenhuan Lu +2
Domain gap often degrades the performance of speaker verification (SV) systems when the statistical distributions of training data and real-world test speech are mismatched. Channe…
You Only Speak Once to See
Wenhao Yang, Jianguo Wei, Wenhuan Lu +1
Grounding objects in images using visual cues is a well-established approach in computer vision, yet the potential of audio as a modality for object recognition and grounding remai…