Anomaly Detection by Robust Statistics

Abstract

Real data often contain anomalous cases, also known as outliers. These may spoil the resulting analysis but they may also contain valuable information. In either case, the ability to detect such anomalies is essential. A useful tool for this purpose is robust statistics, which aims to detect the outliers by first fitting the majority of the data and then flagging data points that deviate from it. We present an overview of several robust methods and the resulting graphical outlier detection tools. We discuss robust procedures for univariate, low-dimensional, and high-dimensional data, such as estimating location and scatter, linear regression, principal component analysis, classification, clustering, and functional data analysis. Also the challenging new topic of cellwise outliers is introduced.

To appear in WIREs Data Mining and Knowledge Discovery

References in corpus (6)

• High-Breakdown Robust Multivariate Methods
• Sparse least trimmed squares regression for analyzing high-dimensional large data sets
• A general trimming approach to robust Cluster Analysis
• Propagation of outliers in multivariate data
• A robust method for cluster analysis
• Multivariate and functional classification using depth and distance

Cited by in corpus (5)

• MacroPCA: An all-in-one PCA method allowing for missing values as well as cellwise and rowwise outliers
• Data Readiness for AI: A 360-Degree Survey
• Robust Monitoring of Time Series with Application to Fraud Detection
• Identifying a Training-Set Attack's Target Using Renormalized Influence Estimation
• Breakdown points of Fermat-Weber problems under gauge distances