185 citations · 236 across the 3 of their papers we have counts for
3 papers
Differentiable Model Compression via Pseudo Quantization Noise
Alexandre Défossez, Yossi Adi, Gabriel Synnaeve
We propose DiffQ a differentiable method for model compression for quantizing model parameters without gradient approximations (e.g., Straight Through Estimator). We suggest adding…
A Simple Convergence Proof of Adam and Adagrad
Alexandre Défossez, Léon Bottou, Francis Bach +1
We provide a simple proof of convergence covering both the Adam and Adagrad adaptive optimization algorithms when applied to smooth (possibly non-convex) objective functions with b…
Music Source Separation in the Waveform Domain
Alexandre Défossez, Nicolas Usunier, Léon Bottou +1
Source separation for music is the task of isolating contributions, or stems, from different instruments recorded individually and arranged together to form a song. Such components…