9 papers
Cloud-Boosted Low-Compute Multi-Channel Speech Enhancement
Xulin Fan, Juan Azcarreta, Ashutosh Pandey +5
Low-latency, low-compute speech enhancement is essential for wearable devices with real-time communication requirements, but strict computational constraints significantly limit on…
Spatial-Magnifier: Spatial upsampling for multichannel speech enhancement
Dongheon Lee, Ashutosh Pandey, Sanjeel Parekh +4
While the spatial directivity of multichannel speech enhancement algorithms improves with the number of microphones, fitting large capture arrays into real-world edge devices is ty…
Towards Localizing Conversation Partners using Head Motion
Payal Mohapatra, Calvin Murdock, Ali Aroudi +4
Many individuals struggle to understand conversation partners in noisy settings, particularly amid background speakers or due to hearing impairments. Emerging wearables like smartg…
Unified Diffusion Refinement for Multi-Channel Speech Enhancement and Separation
Zhongweiyang Xu, Ashutosh Pandey, Juan Azcarreta +4
We propose Uni-ArrayDPS, a novel diffusion-based refinement framework for unified multi-channel speech enhancement and separation. Existing methods for multi-channel speech enhance…
ArrayDPS-Refine: Generative Refinement of Discriminative Multi-Channel Speech Enhancement
Zhongweiyang Xu, Ashutosh Pandey, Juan Azcarreta +3
Multi-channel speech enhancement aims to recover clean speech from noisy multi-channel recordings. Most deep learning methods employ discriminative training, which can lead to non-…
Improving Resource-Efficient Speech Enhancement via Neural Differentiable DSP Vocoder Refinement
Heitor R. Guimarães, Ke Tan, Juan Azcarreta +4
Deploying speech enhancement (SE) systems in wearable devices, such as smart glasses, is challenging due to the limited computational resources on the device. Although deep learnin…