632 citations · 2k across the 38 of their papers we have counts for
11 papers · 1 filter
Mind the Domain Gap: a Systematic Analysis on Bioacoustic Sound Event Detection
Jinhua Liang, Ines Nolasco, Burooj Ghani +3
Detecting the presence of animal vocalisations in nature is essential to study animal populations and their behaviors. A recent development in the field is the introduction of the…
WavCraft: Audio Editing and Generation with Large Language Models
Jinhua Liang, Huan Zhang, Haohe Liu +7
We introduce WavCraft, a collective system that leverages large language models (LLMs) to connect diverse task-specific models for audio content creation and editing. Specifically,…
Acoustic Prompt Tuning: Empowering Large Language Models with Audition Capabilities
Jinhua Liang, Xubo Liu, Wenwu Wang +3
The auditory system plays a substantial role in shaping the overall human perceptual experience. While prevailing large language models (LLMs) and visual language models (VLMs) hav…
Adapting Language-Audio Models as Few-Shot Audio Learners
Jinhua Liang, Xubo Liu, Haohe Liu +4
We presented the Treff adapter, a training-efficient adapter for CLAP, to boost zero-shot classification performance by making use of a small set of labelled data. Specifically, we…
cross-modal fusion techniques for utterance-level emotion recognition from text and speech
Jiachen Luo, Huy Phan, Joshua Reiss
Multimodal emotion recognition (MER) is a fundamental complex research problem due to the uncertainty of human emotional expression and the heterogeneity gap between different moda…
Improving trajectory localization accuracy via direction-of-arrival derivative estimation
Ruchi Pandey, Shreyas Jaiswal, Huy Phan +1
Sound source localization is crucial in acoustic sensing and monitoring-related applications. In this paper, we do a comprehensive analysis of improvement in sound source localizat…
Polyphonic audio event detection: multi-label or multi-class multi-task classification problem?
Huy Phan, Thi Ngoc Tho Nguyen, Philipp Koch +1
Polyphonic events are the main error source of audio event detection (AED) systems. In deep-learning context, the most common approach to deal with event overlaps is to treat the A…
SALSA-Lite: A Fast and Effective Feature for Polyphonic Sound Event Localization and Detection with Microphone Arrays
Thi Ngoc Tho Nguyen, Douglas L. Jones, Karn N. Watcharasupat +2
Polyphonic sound event localization and detection (SELD) has many practical applications in acoustic sensing and monitoring. However, the development of real-time SELD has been lim…
A General Network Architecture for Sound Event Localization and Detection Using Transfer Learning and Recurrent Neural Network
Thi Ngoc Tho Nguyen, Ngoc Khanh Nguyen, Huy Phan +4
Polyphonic sound event detection and localization (SELD) task is challenging because it is difficult to jointly optimize sound event detection (SED) and direction-of-arrival (DOA)…
On Multitask Loss Function for Audio Event Detection and Localization
Huy Phan, Lam Pham, Philipp Koch +3
Audio event localization and detection (SELD) have been commonly tackled using multitask models. Such a model usually consists of a multi-label event classification branch with sig…
Deep Feature Embedding and Hierarchical Classification for Audio Scene Classification
Lam Pham, Ian McLoughlin, Huy Phan +2
In this work, we propose an approach that features deep feature embedding learning and hierarchical classification with triplet loss function for Acoustic Scene Classification (ASC…