7 papers
Conditional Flow Matching for Visually-Guided Acoustic Highlighting
Hugo Malard, Gael Le Lan, Daniel Wong +3
Visually-guided acoustic highlighting seeks to rebalance audio in alignment with the accompanying video, creating a coherent audio-visual experience. While visual saliency and enha…
Residual Learning for Neural Ambisonics Encoders
Thomas Deppisch, Yang Gao, Manan Mittal +4
Emerging wearable devices such as smartglasses and extended reality headsets demand high-quality spatial audio capture from compact, head-worn microphone arrays. Ambisonics provide…
Binaural Signal Matching with Wearable Arrays for Near-Field Sources and Directional Focus
Sapir Goldring, Zamir Ben Hur, David Lou Alon +3
This paper investigates the performance of Binaural Signal Matching (BSM) methods for near-field sound reproduction using a wearable glasses-mounted microphone array. BSM is a flex…
Mixture-of-Experts Framework for Field-of-View Enhanced Signal-Dependent Binauralization of Moving Talkers
Manan Mittal, Thomas Deppisch, Joseph Forrer +4
We propose a novel mixture of experts framework for field-of-view enhancement in binaural signal matching. Our approach enables dynamic spatial audio rendering that adapts to conti…
Binaural Signal Matching with Wearable Arrays for Near-Field Sources
Sapir Goldring, Zamir Ben Hur, David Lou Alon +1
Binaural reproduction methods aim to recreate an acoustic scene for a listener over headphones, offering immersive experiences in applications such as Virtual Reality (VR) and tele…
Ambisonics Encoder for Wearable Array with Improved Binaural Reproduction
Yhonatan Gayer, Vladimir Tourbabin, Zamir Ben-Hur +2
Ambisonics Signal Matching (ASM) is a recently proposed signal-independent approach to encoding Ambisonic signal from wearable microphone arrays, enabling efficient and standardize…