9 papers
Hear Every Sound Object: Rescuing Overlooked Sources in Auditory Scene Analysis
Younghoo Kwon, Yongjoon Lee, Jung-Woo Choi
Auditory scene analysis (ASA) models extract information about individual sound sources from a complex auditory mixture. Recent object-based ASA models process the mixture through…
When Do Self-Supervised Representations Help Speech Restoration?
Yongjoon Lee, Younghoo Kwon, Jung-Woo Choi
Self-supervised learning (SSL) representations are widely used in speech restoration (SR), and the prevailing trend is SSL feature cleansing: fine-tuning the SSL to recover clean f…
MeCo: One-Step MeanFlow-based Corrector for Multi-Channel Speech Separation
Dohwan Kim, Jung-Woo Choi
While discriminative models for multi-channel speech separation excel in reference-based metrics, they often exhibit suboptimal human listening quality. To address this, we propose…
RAF: Relativistic Adversarial Feedback For Universal Speech Synthesis
Yongjoon Lee, Jung-Woo Choi
We propose Relativistic Adversarial Feedback (RAF), a novel training objective for GAN vocoders that improves in-domain fidelity and generalization to unseen scenarios. Although mo…
SEMamba++: A General Speech Restoration Framework Leveraging Global, Local, and Periodic Spectral Patterns
Yongjoon Lee, Jung-Woo Choi
General speech restoration demands techniques that can interpret complex speech structures under various distortions. While State-Space Models like SEMamba have advanced the state-…
Focus Then Listen: An Empirical Study of Plug-and-Play Audio Enhancer for Noise-Robust Large Audio Language Models
Han Yin, Yang Xiao, Younghoo Kwon +2
Large audio language models (LALMs) are a class of foundation models for audio understanding. Existing LALMs tend to degrade significantly in real-world noisy acoustic conditions w…
SoundCompass: Navigating Target Sound Extraction With Effective Directional Clue Integration In Complex Acoustic Scenes
Dayun Choi, Jung-Woo Choi
Recent advances in target sound extraction (TSE) utilize directional clues derived from direction of arrival (DoA), which represent an inherent spatial property of sound available…
CST-former: Multidimensional Attention-based Transformer for Sound Event Localization and Detection in Real Scenes
Yusun Shul, Dayun Choi, Jung-Woo Choi
Sound event localization and detection (SELD) is a task for the classification of sound events and the identification of direction of arrival (DoA) utilizing multichannel acoustic…
CST-former: Transformer with Channel-Spectro-Temporal Attention for Sound Event Localization and Detection
Yusun Shul, Jung-Woo Choi
Sound event localization and detection (SELD) is a task for the classification of sound events and the localization of direction of arrival (DoA) utilizing multichannel acoustic si…