79 citations · 405 across the 40 of their papers we have counts for
41 papers
Array Geometry-Robust Attention-Based Neural Beamformer for Moving Speakers
Marvin Tammen, Tsubasa Ochiai, Marc Delcroix +3
Although mask-based beamforming is a powerful speech enhancement approach, it often requires manual parameter tuning to handle moving speakers. Recently, this approach was augmente…
Neural network-based virtual microphone estimation with virtual microphone and beamformer-level multi-task loss
Hanako Segawa, Tsubasa Ochiai, Marc Delcroix +5
Array processing performance depends on the number of microphones available. Virtual microphone estimation (VME) has been proposed to increase the number of microphone signals arti…
Modified Parametric Multichannel Wiener Filter \\for Low-latency Enhancement of Speech Mixtures with Unknown Number of Speakers
Ning Guo, Tomohiro Nakatani, Shoko Araki +1
This paper introduces a novel low-latency online beamforming (BF) algorithm, named Modified Parametric Multichannel Wiener Filter (Mod-PMWF), for enhancing speech mixtures with unk…
NoisyILRMA: Diffuse-Noise-Aware Independent Low-Rank Matrix Analysis for Fast Blind Source Extraction
Koki Nishida, Norihiro Takamune, Rintaro Ikeshita +3
In this paper, we address the multichannel blind source extraction (BSE) of a single source in diffuse noise environments. To solve this problem even faster than by fast multichann…
Multi-Stream Extension of Variational Bayesian HMM Clustering (MS-VBx) for Combined End-to-End and Vector Clustering-based Diarization
Marc Delcroix, Naohiro Tawara, Mireia Diez +6
Combining end-to-end neural speaker diarization (EEND) with vector clustering (VC), known as EEND-VC, has gained interest for leveraging the strengths of both methods. EEND-VC esti…
Mask-based Neural Beamforming for Moving Speakers with Self-Attention-based Tracking
Tsubasa Ochiai, Marc Delcroix, Tomohiro Nakatani +1
Beamforming is a powerful tool designed to enhance speech signals from the direction of a target source. Computing the beamforming filter requires estimating spatial covariance mat…
Listen only to me! How well can target speech extraction handle false alarms?
Marc Delcroix, Keisuke Kinoshita, Tsubasa Ochiai +3
Target speech extraction (TSE) extracts the speech of a target speaker in a mixture given auxiliary clues characterizing the speaker, such as an enrollment utterance. TSE addresses…
Effective data screening technique for crowdsourced speech intelligibility experiments: Evaluation with IRM-based speech enhancement
Ayako Yamamoto, Toshio Irino, Shoko Araki +4
It is essential to perform speech intelligibility (SI) experiments with human listeners in order to evaluate objective intelligibility measures for developing effective speech enha…
ISS2: An Extension of Iterative Source Steering Algorithm for Majorization-Minimization-Based Independent Vector Analysis
Rintaro Ikeshita, Tomohiro Nakatani
A majorization-minimization (MM) algorithm for independent vector analysis optimizes a separation matrix by minimizing a surr…
Switching Independent Vector Analysis and Its Extension to Blind and Spatially Guided Convolutional Beamforming Algorithms
Tomohiro Nakatani, Rintaro Ikeshita, Keisuke Kinoshita +3
This paper develops a framework that can perform denoising, dereverberation, and source separation accurately by using a relatively small number of microphones. It has been empiric…
Blind and neural network-guided convolutional beamformer for joint denoising, dereverberation, and source separation
Tomohiro Nakatani, Rintaro Ikeshita, Keisuke Kinoshita +2
This paper proposes an approach for optimizing a Convolutional BeamFormer (CBF) that can jointly perform denoising (DN), dereverberation (DR), and source separation (SS). First, we…
Independent Deeply Learned Tensor Analysis for Determined Audio Source Separation
Naoki Narisawa, Rintaro Ikeshita, Norihiro Takamune +4
We address the determined audio source separation problem in the time-frequency domain. In independent deeply learned matrix analysis (IDLMA), it is assumed that the inter-frequenc…
PILOT: Introducing Transformers for Probabilistic Sound Event Localization
Christopher Schymura, Benedikt Bönninghoff, Tsubasa Ochiai +5
Sound event localization aims at estimating the positions of sound sources in the environment with respect to an acoustic receiver (e.g. a microphone array). Recent advances in thi…
Comparison of remote experiments using crowdsourcing and laboratory experiments on speech intelligibility
Ayako Yamamoto, Toshio Irino, Kenichi Arai +4
Many subjective experiments have been performed to develop objective speech intelligibility measures, but the novel coronavirus outbreak has made it very difficult to conduct exper…
Exploiting Attention-based Sequence-to-Sequence Architectures for Sound Event Localization
Christopher Schymura, Tsubasa Ochiai, Marc Delcroix +4
Sound event localization frameworks based on deep neural networks have shown increased robustness with respect to reverberation and noise in comparison to classical parametric appr…
Data Fusion for Audiovisual Speaker Localization: Extending Dynamic Stream Weights to the Spatial Domain
Julio Wissing, Benedikt Boenninghoff, Dorothea Kolossa +6
Estimating the positions of multiple speakers can be helpful for tasks like automatic speech recognition or speaker diarization. Both applications benefit from a known speaker posi…
End-to-End Dereverberation, Beamforming, and Speech Recognition with Improved Numerical Stability and Advanced Frontend
Wangyou Zhang, Christoph Boeddeker, Shinji Watanabe +7
Recently, the end-to-end approach has been successfully applied to multi-speaker speech separation and recognition in both single-channel and multichannel conditions. However, seve…
Speaker activity driven neural speech extraction
Marc Delcroix, Katerina Zmolikova, Tsubasa Ochiai +2
Target speech extraction, which extracts the speech of a target speaker in a mixture given auxiliary speaker clues, has recently received increased interest. Various clues have bee…
Multimodal Attention Fusion for Target Speaker Extraction
Hiroshi Sato, Tsubasa Ochiai, Keisuke Kinoshita +3
Target speaker extraction, which aims at extracting a target speaker's voice from a mixture of voices using audio, visual or locational clues, has received much interest. Recently…
Independent Vector Extraction for Fast Joint Blind Source Separation and Dereverberation
Rintaro Ikeshita, Tomohiro Nakatani
We address a blind source separation (BSS) problem in a noisy reverberant environment in which the number of microphones is greater than the number of sources of interest, and…
A Joint Diagonalization Based Efficient Approach to Underdetermined Blind Audio Source Separation Using the Multichannel Wiener Filter
Nobutaka Ito, Rintaro Ikeshita, Hiroshi Sawada +1
This paper presents a computationally efficient approach to blind source separation (BSS) of audio signals, applicable even when there are more sources than microphones (i.e., the…
Neural Network-based Virtual Microphone Estimator
Tsubasa Ochiai, Marc Delcroix, Tomohiro Nakatani +3
Developing microphone array technologies for a small number of microphones is important due to the constraints of many devices. One direction to address this situation consists of…
Integration of variational autoencoder and spatial clustering for adaptive multi-channel neural speech separation
Katerina Zmolikova, Marc Delcroix, Lukáš Burget +2
In this paper, we propose a method combining variational autoencoder model of speech with a spatial clustering approach for multi-channel speech separation. The advantage of integr…
Convolutive Transfer Function Invariant SDR training criteria for Multi-Channel Reverberant Speech Separation
Christoph Boeddeker, Wangyou Zhang, Tomohiro Nakatani +6
Time-domain training criteria have proven to be very effective for the separation of single-channel non-reverberant speech mixtures. Likewise, mask-based beamforming has shown impr…