31 citations · 243 across the 42 of their papers we have counts for
46 papers
Spiking Neural Beamforming for Multichannel Speech Enhancement on the Edge
Hanan Beit-On, Eli Shapira, Boaz Rafaely
Speech enhancement with wearable and edge devices requires architectures that balance enhancement quality against power and memory resources. Spiking Neural Networks (SNNs) offer a…
Neural Field-of-View for Binaural Signal Matching with Wearable Microphone Arrays
Matan Yifrach, Boaz Rafaely
The growing use of spatial audio in applications such as augmented and virtual reality has driven the development of binaural reproduction methods for wearable arrays with a limite…
Generative Learning for Ambisonic Upscaling
Amit Milstein, Nir Shlezinger, Boaz Rafaely
Ambisonics Upscaling (AU) aims to enhance the spatial resolution of sound fields by estimating high-order Ambisonics (HOA) components from low-order observations. While deep learni…
Array-Agnostic Ambisonics Encoding via Diffusion Posterior Sampling
Amit Milstein, Nir Shlezinger, Boaz Rafaely
Spatial audio enhances user immersion by reproducing 3D sound fields, with Ambisonics being a widely adopted representation. While Ambisonics is theoretically independent of the re…
AmbiDrop: Ambisonics-Based Array-Agnostic Neural Speech Enhancement
Michael Tatarjitzky, Vladimir Tourbabin, Boaz Rafaely
Multichannel Deep Neural Networks (DNNs) have significantly improved speech enhancement performance; however, they typically remain constrained by reliance on fixed microphone arra…
SpatialNet with Binaural Loss Function for Correcting Binaural Signal Matching Outputs under Head Rotations
Dor Shamay, Boaz Rafaely
Binaural reproduction is gaining increasing attention with the rise of devices such as virtual reality headsets, smart glasses, and head-tracked headphones. Achieving accurate bina…
SRP-PHAT-NET: A Reliability-Driven DNN for Reverberant Speaker Localization
Bar Shaybet, Vladimir Tourbabin, Boaz Rafaely
Accurate Direction-of-Arrival (DOA) estimation in reverberant environments remains a fundamental challenge for spatial audio applications. While deep learning methods have shown st…
HyBeam: Hybrid Microphone-Beamforming Array-Agnostic Speech Enhancement for Wearables
Yuval Bar Ilan, Boaz Rafaely, Vladimir Tourbabin
Speech enhancement is a fundamental challenge in signal processing, particularly when robustness is required across diverse acoustic conditions and microphone setups. Deep learning…
Binaural Signal Matching with Wearable Arrays for Near-Field Sources and Directional Focus
Sapir Goldring, Zamir Ben Hur, David Lou Alon +3
This paper investigates the performance of Binaural Signal Matching (BSM) methods for near-field sound reproduction using a wearable glasses-mounted microphone array. BSM is a flex…
An Efficient Neural Network for Modeling Human Auditory Neurograms for Speech
Eylon Zohar, Israel Nelken, Boaz Rafaely
Classical auditory-periphery models, exemplified by Bruce et al., 2018, provide high-fidelity simulations but are stochastic and computationally demanding, limiting large-scale exp…
DiffAU: Diffusion-Based Ambisonics Upscaling
Amit Milstein, Nir Shlezinger, Boaz Rafaely
Spatial audio enhances immersion by reproducing 3D sound fields, with Ambisonics offering a scalable format for this purpose. While first-order Ambisonics (FOA) notably facilitates…
AmbiDrop: Array-Agnostic Speech Enhancement Using Ambisonics Encoding and Dropout-Based Learning
Michael Tatarjitzky, Boaz Rafaely
Multichannel speech enhancement leverages spatial cues to improve intelligibility and quality, but most learning-based methods rely on specific microphone array geometry, unable to…
Binaural Signal Matching with Wearable Arrays for Near-Field Sources
Sapir Goldring, Zamir Ben Hur, David Lou Alon +1
Binaural reproduction methods aim to recreate an acoustic scene for a listener over headphones, offering immersive experiences in applications such as Virtual Reality (VR) and tele…
Ambisonics Encoder for Wearable Array with Improved Binaural Reproduction
Yhonatan Gayer, Vladimir Tourbabin, Zamir Ben-Hur +2
Ambisonics Signal Matching (ASM) is a recently proposed signal-independent approach to encoding Ambisonic signal from wearable microphone arrays, enabling efficient and standardize…
Array-Aware Ambisonics and HRTF Encoding for Binaural Reproduction With Wearable Arrays
Yhonatan Gayer, Vladimir Tourbabin, Zamir Ben Hur +2
This work introduces a novel method for binaural reproduction from arbitrary microphone arrays, based on array-aware optimization of Ambisonics encoding through Head-Related Transf…
Loss functions incorporating auditory spatial perception in deep learning -- a review
Boaz Rafaely, Stefan Weinzierl, Or Berebi +1
Binaural reproduction aims to deliver immersive spatial audio with high perceptual realism over headphones. Loss functions play a central role in optimizing and evaluating algorith…
Ambisonics Binaural Rendering via Masked Magnitude Least Squares
Or Berebi, Fabian Brinkmann, Stefan Weinzierl +1
Ambisonics rendering has become an integral part of 3D audio for headphones. It works well with existing recording hardware, the processing cost is mostly independent of the number…
BSM-iMagLS: ILD Informed Binaural Signal Matching for Reproduction with Head-Mounted Microphone Arrays
Or Berebi, Zamir Ben-Hur, David Lou Alon +1
Headphone listening in applications such as augmented and virtual reality (AR and VR) relies on high-quality spatial audio to ensure immersion, making accurate binaural reproductio…
The importance of spatial and spectral information in multiple speaker tracking
Hanan Beit-On, Vladimir Tourbabin, Boaz Rafaely
Multi-speaker localization and tracking using microphone array recording is of importance in a wide range of applications. One of the challenges with multi-speaker tracking is to a…
Blind Localization of Early Room Reflections with Arbitrary Microphone Array
Yogev Hadadi, Vladimir Tourbabin, Zamir Ben-Hur +2
Blindly estimating the direction of arrival (DoA) of early room reflections without prior knowledge of the room impulse response or source signal is highly valuable in audio signal…
Improved direction of arrival estimations with a wearable microphone array for dynamic environments by reliability weighting
Daniel A. Mitchell, Boaz Rafaely, Anurag Kumar +1
Direction-of-arrival estimation of multiple speakers in a room is an important task for a wide range of applications. In particular, challenging environments with moving speakers,…
Performance and Robustness of Signal-Dependent vs. Signal-Independent Binaural Signal Matching with Wearable Microphone Arrays
Ami Berger, Vladimir Tourbabin, Jacob Donley +2
The increasing popularity of spatial audio in applications such as teleconferencing, entertainment, and virtual reality has led to the recent developments of binaural reproduction…
Assessing the Potential Impact of Direction-Dependent HRTF Selection on Sound Localization Accuracy
Sapir Goldring, Zamir Ben Hur, David Lou Alon +1
This study investigates the approach of direction-dependent selection of Head-Related Transfer Functions (HRTFs) and its impact on sound localization accuracy. For applications suc…
Feasibility of iMagLS-BSM -- ILD Informed Binaural Signal Matching with Arbitrary Microphone Arrays
Or Berebi, Zamir Ben-Hur, David Lou Alon +1
Binaural reproduction for headphone-centric listening has become a focal point in ongoing research, particularly within the realm of advancing technologies such as augmented and vi…