632 citations · 2k across the 38 of their papers we have counts for
7 papers · 1 filter
Acoustic Prompt Tuning: Empowering Large Language Models with Audition Capabilities
Jinhua Liang, Xubo Liu, Wenwu Wang +3
The auditory system plays a substantial role in shaping the overall human perceptual experience. While prevailing large language models (LLMs) and visual language models (VLMs) hav…
ATGNN: Audio Tagging Graph Neural Network
Shubhr Singh, Christian J. Steinmetz, Emmanouil Benetos +2
Deep learning models such as CNNs and Transformers have achieved impressive performance for end-to-end audio tagging. Recent works have shown that despite stacking multiple layers,…
A Deep Learning Architecture with Spatio-Temporal Focusing for Detecting Respiratory Anomalies
Dat Ngo, Lam Pham, Huy Phan +2
This paper presents a deep learning system applied for detecting anomalies from respiratory sound recordings. Our system initially performs audio feature extraction using Continuou…
Adapting Language-Audio Models as Few-Shot Audio Learners
Jinhua Liang, Xubo Liu, Haohe Liu +4
We presented the Treff adapter, a training-efficient adapter for CLAP, to boost zero-shot classification performance by making use of a small set of labelled data. Specifically, we…
An Inception-Residual-Based Architecture with Multi-Objective Loss for Detecting Respiratory Anomalies
Dat Ngo, Lam Pham, Huy Phan +3
This paper presents a deep learning system applied for detecting anomalies from respiratory sound recordings. Initially, our system begins with audio feature extraction using Gamma…
cross-modal fusion techniques for utterance-level emotion recognition from text and speech
Jiachen Luo, Huy Phan, Joshua Reiss
Multimodal emotion recognition (MER) is a fundamental complex research problem due to the uncertainty of human emotional expression and the heterogeneity gap between different moda…