Rule Extraction in Unsupervised Anomaly Detection for Model Explainability: Application to OneClass SVM

Abstract

OneClass SVM is a popular method for unsupervised anomaly detection. As many other methods, it suffers from the black box problem: it is difficult to justify, in an intuitive and simple manner, why the decision frontier is identifying data points as anomalous or non anomalous. Such type of problem is being widely addressed for supervised models. However, it is still an uncharted area for unsupervised learning. In this paper, we evaluate several rule extraction techniques over OneClass SVM models, as well as present alternative designs for some of those algorithms. Together with that, we propose algorithms to compute metrics related with eXplainable Artificial Intelligence (XAI) regarding the "comprehensibility", "representativeness", "stability" and "diversity" of the extracted rules. We evaluate our proposals with different datasets, including real-world data coming from industry. With this, our proposal contributes to extend XAI techniques to unsupervised machine learning models.

23 pages, 18 figures

References in corpus (8)

• Equality of Opportunity in Supervised Learning
• Predictive learning via rule ensembles
• A Unifying Review of Deep and Shallow Anomaly Detection
• One Explanation Does Not Fit All: A Toolkit and Taxonomy of AI Explainability Techniques
• Explanation in Human-AI Systems: A Literature Meta-Review, Synopsis of Key Ideas and Publications, and Bibliography for Explainable AI
• Explainable Matrix -- Visualization for Global and Local Interpretability of Random Forest Classification Ensembles
• Generalized Linear Rule Models
• Looking in the Right place for Anomalies: Explainable AI through Automatic Location Learning

Cited by in corpus (2)

• DeepAID: Interpreting and Improving Deep Learning-based Anomaly Detection in Security Applications
• Vehicle Fuel Optimization Under Real-World Driving Conditions: An Explainable Artificial Intelligence Approach