Showing cs.LGShow all
2 papers · 1 filter
cs.LG2025
DOME: Improving Signal-to-Noise in Stochastic Gradient Descent via Sharp-Direction Subspace Filtering
Julien Nicolas, Mohamed Maouche, Sonia Ben Mokhtar +1
Stochastic gradients for deep neural networks exhibit strong correlations along the optimization trajectory, and are often aligned with a small set of Hessian eigenvectors associat…
cs.LG2024
Differentially private and decentralized randomized power method
Julien Nicolas, César Sabater, Mohamed Maouche +2
The randomized power method has gained significant interest due to its simplicity and efficient handling of large-scale spectral analysis and recommendation tasks. However, its app…