571 citations · 929 across the 39 of their papers we have counts for
10 papers · 1 filter
GS-Codec: A Gaussian-Splatting Bottleneck for Neural Audio Coding
Ron Aluf, Alon Canfi, Eliya Nachmani
Neural audio codecs compress waveforms into compact discrete tokens that underpin speech language models, real-time communication, and large-scale audio storage. Almost every domin…
Multi Codec Discrete Diffusion Model for Text Guided Speech Inpainting and Editing
Iftach Shoham, Tali Dror, Oren Gal +3
Speech recordings often contain missing, corrupted, or incorrect regions that must be reconstructed or modified without re-synthesizing the entire utterance. Speech inpainting rest…
Two-Dimensional Quantization for Geometry-Aware Audio Coding
Tal Shuster, Eliya Nachmani
Recent neural audio codecs have achieved impressive reconstruction quality, typically relying on quantization methods such as Residual Vector Quantization (RVQ), Vector Quantizatio…
Token-Based Audio Inpainting via Discrete Diffusion
Tali Dror, Iftach Shoham, Moshe Buchris +4
Audio inpainting seeks to restore missing segments in degraded recordings. Previous diffusion-based methods exhibit impaired performance when the missing region is large. We introd…
Deep Active Speech Cancellation with Mamba-Masking Network
Yehuda Mishaly, Lior Wolf, Eliya Nachmani
We present a novel deep learning network for Active Speech Cancellation (ASC), advancing beyond Active Noise Cancellation (ANC) methods by effectively canceling both noise and spee…
Zero-Shot Mono-to-Binaural Speech Synthesis
Alon Levkovitch, Julian Salazar, Soroosh Mariooryad +4
We present ZeroBAS, a neural method to synthesize binaural audio from monaural audio recordings and positional information without training on any binaural data. To our knowledge,…
Zero-Shot Voice Conditioning for Denoising Diffusion TTS Models
Alon Levkovitch, Eliya Nachmani, Lior Wolf
We present a novel way of conditioning a pretrained denoising diffusion speech model to produce speech in the voice of a novel person unseen during training. The method requires a…
A-Muze-Net: Music Generation by Composing the Harmony based on the Generated Melody
Or Goren, Eliya Nachmani, Lior Wolf
We present a method for the generation of Midi files of piano music. The method models the right and left hands using two networks, where the left hand is conditioned on the right…
Many-Speakers Single Channel Speech Separation with Optimal Permutation Training
Shaked Dovrat, Eliya Nachmani, Lior Wolf
Single channel speech separation has experienced great progress in the last few years. However, training neural speech separation for a large number of speakers (e.g., more than 10…
Single channel voice separation for unknown number of speakers under reverberant and noisy settings
Shlomo E. Chazan, Lior Wolf, Eliya Nachmani +1
We present a unified network for voice separation of an unknown number of speakers. The proposed approach is composed of several separation heads optimized together with a speaker…