6 citations · 8 across the 20 of their papers we have counts for
22 papers
BCNav: Bearing-Conditioned Depth Policies for Sound Source Navigation
Yaozhong Kang, Jiang Wang, Takeshi Ashizawa +2
The ability to navigate toward sound sources extends a robot's reach beyond its visual field, enabling response to auditory events in unknown environments. To equip robots with thi…
Exploring Efficient Waveform Diffusion Models for Foley Sound Generation
Runwu Shi, Chang Li, Jiahui Li +7
Recent advances in diffusion models have enabled high-fidelity Foley sound generation directly in the waveform space. Existing waveform diffusion models primarily rely on time-doma…
What Do Neural Networks Learn for TDOA Estimation? A Cross-Architecture Probing Study
Yaozhong Kang, Jiang Wang, Runwu Shi +3
Neural networks outperform classical GCC-PHAT for Time-Difference-of-Arrival (TDOA) estimation in noise and reverberation, yet their internal strategy remains unexplored. To uncove…
Fast-SDE: Efficient Single-Microphone Sound Source Distance Estimation in Reverberant Environments
Jiang Wang, Runwu Shi, Yaozhong Kang +3
Sound source distance estimation (SDE) is a critical capability in human-robot interaction. An inappropriate interaction distance not only reduces the reliability of speech acquisi…
Ecologically-Constrained Task Arithmetic for Multi-Taxa Bioacoustic Classifiers Without Shared Data
Ragib Amin Nihal, Benjamin Yen, Runwu Shi +2
Training data for bioacoustics is scattered across taxa, regions, and institutions. Centralizing it all is often infeasible. We show that independently fine-tuned BEATs encoders ca…
Unsupervised Single-Channel Audio Separation with Diffusion Source Priors
Runwu Shi, Chang Li, Jiang Wang +5
Single-channel audio separation aims to separate individual sources from a single-channel mixture. Most existing methods rely on supervised learning with synthetically generated pa…
Dialect Identification Using Resource-Efficient Fine-Tuning Approaches
Zirui Lin, Haris Gulzar, Monnika Roslianna Busto +3
Dialect Identification (DI) is a task to recognize different dialects within the same language from a speech signal. DI can help to improve the downstream speech related tasks even…
Pattern Enhanced Multi-Turn Jailbreaking: Exploiting Structural Vulnerabilities in Large Language Models
Ragib Amin Nihal, Rui Wen, Kazuhiro Nakadai +1
Large language models (LLMs) remain vulnerable to multi-turn jailbreaking attacks that exploit conversational context to bypass safety constraints gradually. These attacks target d…
Cross-Attention with Confidence Weighting for Multi-Channel Audio Alignment
Ragib Amin Nihal, Benjamin Yen, Takeshi Ashizawa +1
Multi-channel audio alignment is a key requirement in bioacoustic monitoring, spatial audio systems, and acoustic localization. However, existing methods often struggle to address…
Knowledge-Augmented Vision Language Models for Underwater Bioacoustic Spectrogram Analysis
Ragib Amin Nihal, Benjamin Yen, Takeshi Ashizawa +1
Marine mammal vocalization analysis depends on interpreting bioacoustic spectrograms. Vision Language Models (VLMs) are not trained on these domain-specific visualizations. We inve…
Single-Microphone-Based Sound Source Localization for Mobile Robots in Reverberant Environments
Jiang Wang, Runwu Shi, Benjamin Yen +2
Accurately estimating sound source positions is crucial for robot audition. However, existing sound source localization methods typically rely on a microphone array with at least t…
Observability-Aware Active Calibration of Multi-Sensor Extrinsics for Ground Robots via Online Trajectory Optimization
Jiang Wang, Yaozhong Kang, Linya Fu +2
Accurate calibration of sensor extrinsic parameters for ground robotic systems (i.e., relative poses) is crucial for ensuring spatial alignment and achieving high-performance perce…
Single-Channel Target Speech Extraction Utilizing Distance and Room Clues
Runwu Shi, Zirui Lin, Benjamin Yen +3
This paper aims to achieve single-channel target speech extraction (TSE) in enclosures utilizing distance clues and room information. Recent works have verified the feasibility of…
An Efficient GPU-based Implementation for Noise Robust Sound Source Localization
Zirui Lin, Masayuki Takigahira, Naoya Terakado +6
Robot audition, encompassing Sound Source Localization (SSL), Sound Source Separation (SSS), and Automatic Speech Recognition (ASR), enables robots and smart devices to acquire aud…
Weakly Supervised Detection and Temporal Localization of Whale Calls in Long-Duration Bioacoustic Data
Ragib Amin Nihal, Benjamin Yen, Runwu Shi +2
Passive acoustic monitoring (PAM) systems generate continuous recordings spanning months, yet automated bioacoustic analysis of whale calls requires two separate annotation efforts…
Bird Vocalization Embedding Extraction Using Self-Supervised Disentangled Representation Learning
Runwu Shi, Katsutoshi Itoyama, Kazuhiro Nakadai
This paper addresses the extraction of the bird vocalization embedding from the whole song level using disentangled representation learning (DRL). Bird vocalization embeddings are…
Distance Based Single-Channel Target Speech Extraction
Runwu Shi, Benjamin Yen, Kazuhiro Nakadai
This paper aims to achieve single-channel target speech extraction (TSE) in enclosures by solely utilizing distance information. This is the first work that utilizes only distance…
UAV-Enhanced Combination to Application: Comprehensive Analysis and Benchmarking of a Human Detection Dataset for Disaster Scenarios
Ragib Amin Nihal, Benjamin Yen, Katsutoshi Itoyama +1
Unmanned aerial vehicles (UAVs) have revolutionized search and rescue (SAR) operations, but the lack of specialized human detection datasets for training machine learning models po…
Can all variations within the unified mask-based beamformer framework achieve identical peak extraction performance?
Atsuo Hiroe, Katsutoshi Itoyama, Kazuhiro Nakadai
This study investigates mask-based beamformers (BFs), which estimate filters for target sound extraction (TSE) using time-frequency masks. Although multiple mask-based BFs have bee…
SLAM-based Joint Calibration of Multiple Asynchronous Microphone Arrays and Sound Source Localization
Jiang Wang, Yuanzheng He, Daobilige Su +6
Robot audition systems with multiple microphone arrays have many applications in practice. However, accurate calibration of multiple microphone arrays remains challenging because t…
From Blurry to Brilliant Detection: YOLO-Based Aerial Object Detection with Super Resolution
Ragib Amin Nihal, Benjamin Yen, Takeshi Ashizawa +2
Aerial object detection presents challenges from small object sizes, high density clustering, and image quality degradation from distance and motion blur. These factors create an i…
Is the Ideal Ratio Mask Really the Best? -- Exploring the Best Extraction Performance and Optimal Mask of Mask-based Beamformers
Atsuo Hiroe, Katsutoshi Itoyama, Kazuhiro Nakadai
This study investigates mask-based beamformers (BFs), which estimate filters to extract target speech using time-frequency masks. Although several BF methods have been proposed, th…