2 citations · 3 across the 5 of their papers we have counts for
6 papers
A Harness for Synthesizing Diverse Naturalistic Full-Duplex Conversations
Matthew Sun, Vinay Kothapally, Meng Yu +4
Full-duplex dialogue systems, which listen while speaking, must distinguish a completed turn from a pause within a turn and an interruption that requests a turn from a brief acknow…
LLM-Enhanced Dialogue Management for Full-Duplex Spoken Dialogue Systems
Hao Zhang, Weiwei Li, Rilin Chen +3
Achieving full-duplex communication in spoken dialogue systems (SDS) requires real-time coordination between listening, speaking, and thinking. This paper proposes a semantic voice…
Neural Ambisonic Encoding For Multi-Speaker Scenarios Using A Circular Microphone Array
Yue Qiao, Vinay Kothapally, Meng Yu +1
Spatial audio formats like Ambisonics are playback device layout-agnostic and well-suited for applications such as teleconferencing and virtual reality. Conventional Ambisonic enco…
SpatialCodec: Neural Spatial Speech Coding
Zhongweiyang Xu, Yong Xu, Vinay Kothapally +3
In this work, we address the challenge of encoding speech captured by a microphone array using deep learning techniques with the aim of preserving and accurately reconstructing cru…
Deep Neural Mel-Subband Beamformer for In-car Speech Separation
Vinay Kothapally, Yong Xu, Meng Yu +2
While current deep learning (DL)-based beamforming techniques have been proved effective in speech separation, they are often designed to process narrow-band (NB) frequencies indep…
Joint Neural AEC and Beamforming with Double-Talk Detection
Vinay Kothapally, Yong Xu, Meng Yu +2
Acoustic echo cancellation (AEC) in full-duplex communication systems eliminates acoustic feedback. However, nonlinear distortions induced by audio devices, background noise, rever…