2 citations · 3 across the 8 of their papers we have counts for
10 papers
Selective Listening: Mechanism-Guided Control of Audio Influence in Large Audio-Language Models
Yulin Sun, Kele Xu, Yong Dou
Large audio-language models (LALMs) exploit multimodal evidence, yet task-irrelevant audio can alter text-reasoning decisions when listening is unnecessary. Aggregate Accuracy can…
Prediction-Layer Branch Calibration for Multimodal Sentiment Analysis
Yulin Sun, Kele Xu, Yong Dou
Multimodal sentiment analysis integrates textual, acoustic and visual cues, yet current language-model-based fusion methods typically leave prediction-layer branch allocation impli…
MAny: Merge Anything for Multimodal Continual Instruction Tuning
Zijian Gao, Wangwang Jia, Xingxing Zhang +6
Multimodal Continual Instruction Tuning (MCIT) is essential for sequential task adaptation of Multimodal Large Language Models (MLLMs) but is severely restricted by catastrophic fo…
BeamformNet: Deep Learning-Based Beamforming Method for DoA Estimation via Implicit Spatial Signal Focusing and Noise Suppression
Xuyao Deng, Yong Dou, Kele Xu
Deep learning-based direction-of-arrival (DoA) estimation has gained increasing popularity. A popular family of DoA estimation algorithms is beamforming methods, which operate by c…
Unify Variables in Neural Scaling Laws for General Audio Representations via Embedding Effective Rank
Xuyao Deng, Yanjie Sun, Yong Dou +1
Scaling laws have profoundly shaped our understanding of model performance in computer vision and natural language processing, yet their application to general audio representation…
Spatial Signal Focusing and Noise Suppression for Direction-of-Arrival Estimation in Large-Aperture 2D Arrays under Demanding Conditions
Xuyao Deng, Yong Dou, Kele Xu
Direction-of-Arrival (DOA) estimation in sensor arrays faces limitations under demanding conditions, including low signal-to-noise ratio, single-snapshot scenarios, coherent source…
AudioSet-R: A Refined AudioSet with Multi-Stage LLM Label Reannotation
Yulin Sun, Qisheng Xu, Yi Su +4
AudioSet is a widely used benchmark in the audio research community and has significantly advanced various audio-related tasks. However, persistent issues with label accuracy and c…
Audio-Language Models for Audio-Centric Tasks: A Systematic Survey
Yi Su, Jisheng Bai, Qisheng Xu +2
Audio-Language Models (ALMs), trained on paired audio-text data, are designed to process, understand, and reason about audio-centric multimodal content. Unlike traditional supervis…
AudioCIL: A Python Toolbox for Audio Class-Incremental Learning with Multiple Scenes
Qisheng Xu, Yulin Sun, Yi Su +7
Deep learning, with its robust aotomatic feature extraction capabilities, has demonstrated significant success in audio signal processing. Typically, these methods rely on static,…
Contrastive Learning-based Chaining-Cluster for Multilingual Voice-Face Association
Wuyang Chen, Yanjie Sun, Kele Xu +1
The innate correlation between a person's face and voice has recently emerged as a compelling area of study, especially within the context of multilingual environments. This paper…