185 citations · 236 across the 3 of their papers we have counts for
Showing stat.MLShow all
2 papers · 1 filter
stat.ML2021★ 19 cited
Differentiable Model Compression via Pseudo Quantization Noise
Alexandre Défossez, Yossi Adi, Gabriel Synnaeve
We propose DiffQ a differentiable method for model compression for quantizing model parameters without gradient approximations (e.g., Straight Through Estimator). We suggest adding…
stat.ML2020★ 32 cited
A Simple Convergence Proof of Adam and Adagrad
Alexandre Défossez, Léon Bottou, Francis Bach +1
We provide a simple proof of convergence covering both the Adam and Adagrad adaptive optimization algorithms when applied to smooth (possibly non-convex) objective functions with b…