Quantile-based Loss Filtering for Outlier-Robust Stochastic Gradient Descent

Jamie Haddock, Anna Ma, Elizaveta Rebrova

We study loss-based filtering for finite-sum optimization with a subset of corrupted component functions whose gradients may be highly unreliable. Motivated by minimum-loss-based S…