2 citations · 3 across the 15 of their papers we have counts for
15 papers
M3-DuplexBench: A Multi-Turn, Multilingual, Multidomain Benchmark for Full-Duplex Spoken Dialogue Models
Ryo Fukuda, Atsushi Ando, Hiroki Kanagawa +4
Full-duplex spoken dialogue systems (FDSDSs) can listen while speaking, enabling natural conversational behaviors such as smooth turn-taking, backchannel handling, and user barge-i…
Evaluating Large Language Models Abilities for Addressee, Turn-change, and Next Speaker Prediction in Meetings
Ryo Fukuda, Takatomo Kano, Siddhant Arora +7
We investigate turn-taking in multimodal multi-party conversations using large language models (LLMs). We construct an evaluation framework for three tasks: addressee detection, tu…
Tight Boundary Prediction in Speaker Diarization Using Causal-Anticausal Consistency
Shota Horiguchi, Marc Delcroix, Naohiro Tawara +2
Multi-talker conversational automatic speech recognition data are often used to train speaker diarization models. Because such data prioritize semantic continuity, pauses and bound…
Can We Really Repurpose Multi-Speaker ASR Corpus for Speaker Diarization?
Shota Horiguchi, Naohiro Tawara, Takanori Ashihara +2
Neural speaker diarization is widely used for overlap-aware speaker diarization, but it requires large multi-speaker datasets for training. To meet this data requirement, large dat…
Mitigating Non-Target Speaker Bias in Guided Speaker Embedding
Shota Horiguchi, Takanori Ashihara, Marc Delcroix +2
Obtaining high-quality speaker embeddings in multi-speaker conditions is crucial for many applications. A recently proposed guided speaker embedding framework, which utilizes speec…
Dissecting the Segmentation Model of End-to-End Diarization with Vector Clustering
Alexis Plaquet, Naohiro Tawara, Marc Delcroix +4
End-to-End Neural Diarization with Vector Clustering is a powerful and practical approach to perform Speaker Diarization. Multiple enhancements have been proposed for the segmentat…
Pretraining Multi-Speaker Identification for Neural Speaker Diarization
Shota Horiguchi, Atsushi Ando, Marc Delcroix +1
End-to-end speaker diarization enables accurate overlap-aware diarization by jointly estimating multiple speakers' speech activities in parallel. This approach is data-hungry, requ…
Microphone Array Geometry Independent Multi-Talker Distant ASR: NTT System for the DASR Task of the CHiME-8 Challenge
Naoyuki Kamo, Naohiro Tawara, Atsushi Ando +15
In this paper, we introduce a multi-talker distant automatic speech recognition (DASR) system we designed for the DASR task 1 of the CHiME-8 challenge. Our system performs speaker…
Mamba-based Segmentation Model for Speaker Diarization
Alexis Plaquet, Naohiro Tawara, Marc Delcroix +3
Mamba is a newly proposed architecture which behaves like a recurrent neural network (RNN) with attention-like capabilities. These properties are promising for speaker diarization,…
Guided Speaker Embedding
Shota Horiguchi, Takafumi Moriya, Atsushi Ando +4
This paper proposes a guided speaker embedding extraction system, which extracts speaker embeddings of the target speaker using speech activities of target and interference speaker…
NTT Multi-Speaker ASR System for the DASR Task of CHiME-8 Challenge
Naoyuki Kamo, Naohiro Tawara, Atsushi Ando +15
We present a distant automatic speech recognition (DASR) system developed for the CHiME-8 DASR track. It consists of a diarization first pipeline. For diarization, we use end-to-en…
Recursive Attentive Pooling for Extracting Speaker Embeddings from Multi-Speaker Recordings
Shota Horiguchi, Atsushi Ando, Takafumi Moriya +4
This paper proposes a method for extracting speaker embedding for each speaker from a variable-length recording containing multiple speakers. Speaker embeddings are crucial not onl…
SpeakerBeam-SS: Real-time Target Speaker Extraction with Lightweight Conv-TasNet and State Space Modeling
Hiroshi Sato, Takafumi Moriya, Masato Mimura +6
Real-time target speaker extraction (TSE) is intended to extract the desired speaker's voice from the observed mixture of multiple speakers in a streaming manner. Implementing real…
Speech Rhythm-Based Speaker Embeddings Extraction from Phonemes and Phoneme Duration for Multi-Speaker Speech Synthesis
Kenichi Fujita, Atsushi Ando, Yusuke Ijima
This paper proposes a speech rhythm-based method for speaker embeddings to model phoneme duration using a few utterances by the target speaker. Speech rhythm is one of the essentia…
NTT speaker diarization system for CHiME-7: multi-domain, multi-microphone End-to-end and vector clustering diarization
Naohiro Tawara, Marc Delcroix, Atsushi Ando +1
This paper details our speaker diarization system designed for multi-domain, multi-microphone casual conversations. The proposed diarization pipeline uses weighted prediction error…