106 citations · 110 across the 10 of their papers we have counts for
4 papers · 1 filter
DOME: Improving Signal-to-Noise in Stochastic Gradient Descent via Sharp-Direction Subspace Filtering
Julien Nicolas, Mohamed Maouche, Sonia Ben Mokhtar +1
Stochastic gradients for deep neural networks exhibit strong correlations along the optimization trajectory, and are often aligned with a small set of Hessian eigenvectors associat…
GRANITE : a Byzantine-Resilient Dynamic Gossip Learning Framework
Yacine Belal, Mohamed Maouche, Sonia Ben Mokhtar
Gossip Learning (GL) is a decentralized learning paradigm where users iteratively exchange and aggregate models with a small set of neighboring peers. Recent approaches rely on dyn…
Exposing the Vulnerability of Decentralized Learning to Membership Inference Attacks Through the Lens of Graph Mixing
Ousmane Touat, Jezekael Brunon, Yacine Belal +4
The primary promise of decentralized learning is to allow users to engage in the training of machine learning models in a collaborative manner while keeping their data on their pre…
Differentially private and decentralized randomized power method
Julien Nicolas, César Sabater, Mohamed Maouche +2
The randomized power method has gained significant interest due to its simplicity and efficient handling of large-scale spectral analysis and recommendation tasks. However, its app…