11 papers
Exploring Efficient Waveform Diffusion Models for Foley Sound Generation
Runwu Shi, Chang Li, Jiahui Li +7
Recent advances in diffusion models have enabled high-fidelity Foley sound generation directly in the waveform space. Existing waveform diffusion models primarily rely on time-doma…
What Do Neural Networks Learn for TDOA Estimation? A Cross-Architecture Probing Study
Yaozhong Kang, Jiang Wang, Runwu Shi +3
Neural networks outperform classical GCC-PHAT for Time-Difference-of-Arrival (TDOA) estimation in noise and reverberation, yet their internal strategy remains unexplored. To uncove…
Fast-SDE: Efficient Single-Microphone Sound Source Distance Estimation in Reverberant Environments
Jiang Wang, Runwu Shi, Yaozhong Kang +3
Sound source distance estimation (SDE) is a critical capability in human-robot interaction. An inappropriate interaction distance not only reduces the reliability of speech acquisi…
ASAP: An Azimuth-Priority Strip-Based Search Approach to Planar Microphone Array DOA Estimation in 3D
Ming Huang, Shuting Xu, Leying Yang +6
Direction-of-arrival (DOA) estimation is an important task in microphone array processing and many downstream applications. The steered response power with phase transform (SRP-PHA…
Unsupervised Single-Channel Speech Separation with Diffusion under Speaker-Embedding Guidance
Runwu Shi, Kai Li, Yiyan Wang +5
Speech separation is a fundamental task in audio processing, typically addressed with fully supervised systems trained on paired mixtures. While effective, such systems typically r…
Single-Microphone-Based Sound Source Localization for Mobile Robots in Reverberant Environments
Jiang Wang, Runwu Shi, Benjamin Yen +2
Accurately estimating sound source positions is crucial for robot audition. However, existing sound source localization methods typically rely on a microphone array with at least t…
Observability-Aware Active Calibration of Multi-Sensor Extrinsics for Ground Robots via Online Trajectory Optimization
Jiang Wang, Yaozhong Kang, Linya Fu +2
Accurate calibration of sensor extrinsic parameters for ground robotic systems (i.e., relative poses) is crucial for ensuring spatial alignment and achieving high-performance perce…
Single-Channel Target Speech Extraction Utilizing Distance and Room Clues
Runwu Shi, Zirui Lin, Benjamin Yen +3
This paper aims to achieve single-channel target speech extraction (TSE) in enclosures utilizing distance clues and room information. Recent works have verified the feasibility of…
Improved Extrinsic Calibration of Acoustic Cameras via Batch Optimization
Zhi Li, Jiang Wang, Xiaoyang Li +1
Acoustic cameras have found many applications in practice. Accurate and reliable extrinsic calibration of the microphone array and visual sensors within acoustic cameras is crucial…
SLAM-based Joint Calibration of Multiple Asynchronous Microphone Arrays and Sound Source Localization
Jiang Wang, Yuanzheng He, Daobilige Su +6
Robot audition systems with multiple microphone arrays have many applications in practice. However, accurate calibration of multiple microphone arrays remains challenging because t…
Asynchronous Microphone Array Calibration using Hybrid TDOA Information
Chengjie Zhang, Jiang Wang, He Kong
Asynchronous microphone array calibration is a prerequisite for many audition robot applications. A popular solution to the above calibration problem is the batch form of Simultane…