Adversarial robust weighted Huber regression

Abstract

We consider a robust estimation of linear regression coefficients. In this note, we focus on the case where the covariates are sampled from an $L$-subGaussian distribution with unknown covariance, the noises are sampled from a distribution with a bounded absolute moment and both covariates and noises may be contaminated by an adversary. We derive an estimation error bound, which depends on the stable rank and the condition number of the covariance matrix of covariates with a polynomial computational complexity of estimation.

The case of sparse coefficients is investigated in arXiv:2208.11592. This manuscript will not be submitted for publications

References in corpus (8)

• Recent Advances in Algorithmic High-Dimensional Robust Statistics
• Robust regression with covariate filtering: Heavy tails and adversarial contamination
• Faster Algorithms for High-Dimensional Robust Covariance Estimation
• Optimal Robust Linear Regression in Nearly Linear Time
• All-In-One Robust Estimator of the Gaussian Mean
• Subgaussian sequences in probability and Fourier analysis
• Outlier Robust Mean Estimation with Subgaussian Rates via Stability
• High-Dimensional Robust Mean Estimation via Gradient Descent