European Union regulations on algorithmic decision-making and a "right to explanation"
arXiv:1606.08813 · doi:10.1609/aimag.v38i3.2741
Abstract
We summarize the potential impact that the European Union's new General Data Protection Regulation will have on the routine use of machine learning algorithms. Slated to take effect as law across the EU in 2018, it will restrict automated individual decision-making (that is, algorithms that make decisions based on user-level predictors) which "significantly affect" users. The law will also effectively create a "right to explanation," whereby a user can ask for an explanation of an algorithmic decision that was made about them. We argue that while this law will pose large challenges for industry, it highlights opportunities for computer scientists to take the lead in designing algorithms and evaluation frameworks which avoid discrimination and enable explanation.
arXiv commentpresented at 2016 ICML Workshop on Human Interpretability in Machine Learning (WHI 2016), New York, NY
Cited by in corpus (225)
- Towards A Rigorous Science of Interpretable Machine Learning
- Interpretable machine learning: definitions, methods, and applications
- Explaining Deep Neural Networks and Beyond: A Review of Methods and Applications
- Understanding Black-box Predictions via Influence Functions
- Explainable Machine Learning for Scientific Insights and Discoveries
- Explainable Artificial Intelligence: Understanding, Visualizing and Interpreting Deep Learning Models
- Unmasking Clever Hans Predictors and Assessing What Machines Really Learn
- A Survey on the Explainability of Supervised Machine Learning
- A Unifying Review of Deep and Shallow Anomaly Detection
- The role of explainability in creating trustworthy artificial intelligence for health care: a comprehensive survey of the terminology, design choices, and evaluation strategies
- What Do We Want From Explainable Artificial Intelligence (XAI)? -- A Stakeholder Perspective on XAI and a Conceptual Model Guiding Interdisciplinary XAI Research
- A Survey on Active Learning and Human-in-the-Loop Deep Learning for Medical Image Analysis
- Towards Explainable Artificial Intelligence
- Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)
- The Measure and Mismeasure of Fairness
- Explainable Artificial Intelligence Applications in Cyber Security: State-of-the-Art in Research
- Arming the public with artificial intelligence to counter social bots
- Deep k-Nearest Neighbors: Towards Confident, Interpretable and Robust Deep Learning
- A Comprehensive Survey on Deep Graph Representation Learning
- How Algorithmic Confounding in Recommendation Systems Increases Homogeneity and Decreases Utility
- A Comprehensive Taxonomy for Explainable Artificial Intelligence: A Systematic Survey of Surveys on Methods and Concepts
- State Representation Learning for Control: An Overview
- Explaining a Series of Models by Propagating Shapley Values
- Towards Human-centered Explainable AI: A Survey of User Studies for Model Explanations
- Explainable Artificial Intelligence (XAI) from a user perspective- A synthesis of prior literature and problematizing avenues for future research
- Metrics for Explainable AI: Challenges and Prospects
- Bayesian Neural Networks: An Introduction and Survey
- "Brilliant AI Doctor" in Rural China: Tensions and Challenges in AI-Powered CDSS Deployment
- SecureBoost: A Lossless Federated Learning Framework
- Explainable Artificial Intelligence: Precepts, Methods, and Opportunities for Research in Construction
- Implementations in Machine Ethics: A Survey
- Algorithmic decision-making in AVs: Understanding ethical and technical concerns for smart cities
- Stop ordering machine learning algorithms by their explainability! A user-centered investigation of performance and explainability
- Levels of explainable artificial intelligence for human-aligned conversational explanations
- Decision Provenance: Harnessing data flow for accountable systems
- Robust Explainability: A Tutorial on Gradient-Based Attribution Methods for Deep Neural Networks
- Machine Learning Testing: Survey, Landscapes and Horizons
- Learning Certifiably Optimal Rule Lists for Categorical Data
- GeoShapley: A Game Theory Approach to Measuring Spatial Effects in Machine Learning Models
- Hierarchical interpretations for neural network predictions
- How to Certify Machine Learning Based Safety-critical Systems? A Systematic Literature Review
- To trust or not to trust an explanation: using LEAF to evaluate local linear XAI methods
- Towards Automatic Concept-based Explanations
- The challenges of deploying artificial intelligence models in a rapidly evolving pandemic
- Fairness and Transparency in Recommendation: The Users' Perspective
- ExplAIn: Explanatory Artificial Intelligence for Diabetic Retinopathy Diagnosis
- A Survey on XAI for 5G and Beyond Security: Technical Aspects, Challenges and Research Directions
- Implementing local-explainability in Gradient Boosting Trees: Feature Contribution
- Counterfactual Explanation Algorithms for Behavioral and Textual Data
- Responsible and Regulatory Conform Machine Learning for Medicine: A Survey of Challenges and Solutions
- Explainable Machine Learning for Public Policy: Use Cases, Gaps, and Research Directions
- Domain-Incremental Continual Learning for Mitigating Bias in Facial Expression and Action Unit Recognition
- How Case Based Reasoning Explained Neural Networks: An XAI Survey of Post-Hoc Explanation-by-Example in ANN-CBR Twins
- Tree-based local explanations of machine learning model predictions, AraucanaXAI
- The Doctor Just Won't Accept That!
- SoK: Content Moderation in Social Media, from Guidelines to Enforcement, and Research to Practice
- The Conflict Between Explainable and Accountable Decision-Making Algorithms
- Sparsity in Optimal Randomized Classification Trees
- Bias in Machine Learning -- What is it Good for?
- Hierarchical Label-wise Attention Transformer Model for Explainable ICD Coding
- Interpreting recurrent neural networks behaviour via excitable network attractors
- Explaining Deep Neural Networks with a Polynomial Time Algorithm for Shapley Values Approximation
- Assessing the Local Interpretability of Machine Learning Models
- Optimal randomized classification trees
- Understanding and Benchmarking the Impact of GDPR on Database Systems
- Post Processing Recommender Systems with Knowledge Graphs for Recency, Popularity, and Diversity of Explanations
- Towards Moral Autonomous Systems
- On Interpretability of Artificial Neural Networks: A Survey
- Stop Explaining Black Box Machine Learning Models for High Stakes Decisions and Use Interpretable Models Instead
- A Critical Survey on Fairness Benefits of Explainable AI
- Bias Amplification in Artificial Intelligence Systems
- Stakeholders in Explainable AI
- The Grammar of Interactive Explanatory Model Analysis
- Amazon SageMaker Clarify: Machine Learning Bias Detection and Explainability in the Cloud
- On Explaining Machine Learning Models by Evolving Crucial and Compact Features
- Bridging the Transparency Gap: What Can Explainable AI Learn From the AI Act?
- From Learning to Relearning: A Framework for Diminishing Bias in Social Robot Navigation
- Posthoc Interpretability of Learning to Rank Models using Secondary Training Data
- Towards Explainable Neural-Symbolic Visual Reasoning
- Landscape of R packages for eXplainable Artificial Intelligence
- Improving Clinician Performance in Classification of EEG Patterns on the Ictal-Interictal-Injury Continuum using Interpretable Machine Learning
- Detecting Statistical Interactions from Neural Network Weights
- Open Challenges in Synthetic Speech Detection
- Symbolic Knowledge Extraction and Injection with Sub-symbolic Predictors: A Systematic Literature Review
- Interpreting Classifiers through Attribute Interactions in Datasets
- A Survey on Neural Network Interpretability
- Path To Gain Functional Transparency In Artificial Intelligence With Meaningful Explainability
- Explaining Deep Learning-based Anomaly Detection in Energy Consumption Data by Focusing on Contextually Relevant Data
- Interpretable Deep Models for Cardiac Resynchronisation Therapy Response Prediction
- The Price of Interpretability
- Applications of Generative AI in Healthcare: algorithmic, ethical, legal and societal considerations
- Regional Multi-scale Approach for Visually Pleasing Explanations of Deep Neural Networks
- Philosophy within Data Science Ethics Courses
- The effectiveness of feature attribution methods and its correlation with automatic evaluation scores
- From social netizens to data citizens: variations of GDPR awareness in 28 European countries
- The Bouncer Problem: Challenges to Remote Explainability
- Superhuman performance in urology board questions by an explainable large language model enabled for context integration of the European Association of Urology guidelines: the UroBot study
- Regularization Learning Networks: Deep Learning for Tabular Datasets
- Now You See Me (CME): Concept-based Model Extraction
- Producing radiologist-quality reports for interpretable artificial intelligence
- Towards Interpretable-AI Policies Induction using Evolutionary Nonlinear Decision Trees for Discrete Action Systems
- Model extraction from counterfactual explanations
- Evaluating Privacy-Preserving Machine Learning in Critical Infrastructures: A Case Study on Time-Series Classification
- SLISEMAP: Supervised dimensionality reduction through local explanations
- Experimenting with Emerging RISC-V Systems for Decentralised Machine Learning
- Interpret Federated Learning with Shapley Values
- Towards responsible AI for education: Hybrid human-AI to confront the Elephant in the room
- Fairwashing: the risk of rationalization
- Counterfactuals and Causability in Explainable Artificial Intelligence: Theory, Algorithms, and Applications
- Improving Fairness in Speaker Recognition
- How to Measure Gender Bias in Machine Translation: Optimal Translators, Multiple Reference Points
- Benchmarking Instance-Centric Counterfactual Algorithms for XAI: From White Box to Black Box
- What does it mean to solve the problem of discrimination in hiring? Social, technical and legal perspectives from the UK on automated hiring systems
- Concept-based Explainable Artificial Intelligence: A Survey
- Evaluating the stability of model explanations in instance-dependent cost-sensitive credit scoring
- Exact and Consistent Interpretation for Piecewise Linear Neural Networks: A Closed Form Solution
- Transparency, Auditability and eXplainability of Machine Learning Models in Credit Scoring
- Domain Knowledge Aided Explainable Artificial Intelligence for Intrusion Detection and Response
- Explaining Any ML Model? -- On Goals and Capabilities of XAI
- Under the Hood of Neural Networks: Characterizing Learned Representations by Functional Neuron Populations and Network Ablations
- Beyond the technical challenges for deploying Machine Learning solutions in a software company
- Causal Interpretability for Machine Learning -- Problems, Methods and Evaluation
- Evaluating the Stability of Semantic Concept Representations in CNNs for Robust Explainability
- Explaining Explanations to Society
- CausalX: Causal Explanations and Block Multilinear Factor Analysis
- The Seven Sins of Personal-Data Processing Systems under GDPR
- The Best Decisions Are Not the Best Advice: Making Adherence-Aware Recommendations
- Disentangled Attribution Curves for Interpreting Random Forests and Boosted Trees
- Progressive Disclosure: Designing for Effective Transparency
- Towards Global Explanations for Credit Risk Scoring
- RelatIF: Identifying Explanatory Training Examples via Relative Influence
- Learning Interpretable Rules for Multi-label Classification
- TreeC: a method to generate interpretable energy management systems using a metaheuristic algorithm
- Unexplainability and Incomprehensibility of Artificial Intelligence
- Towards consistency of rule-based explainer and black box model -- fusion of rule induction and XAI-based feature importance
- Counterfactual Analysis and Target Setting in Benchmarking
- Bioinformatics and Medicine in the Era of Deep Learning
- A mixed-integer programming model for identifying intuitive ambulance dispatching policies
- Comprehension Is a Double-Edged Sword: Over-Interpreting Unspecified Information in Intelligible Machine Learning Explanations
- Interpretability with Accurate Small Models
- Characterizing Intersectional Group Fairness with Worst-Case Comparisons
- Imparting Interpretability to Word Embeddings while Preserving Semantic Structure
- timeXplain -- A Framework for Explaining the Predictions of Time Series Classifiers
- Truthful AI: Developing and governing AI that does not lie
- Human-Centered Evaluation of XAI Methods
- Revealing Neural Network Bias to Non-Experts Through Interactive Counterfactual Examples
- Incorporating Priors with Feature Attribution on Text Classification
- CounteRGAN: Generating Realistic Counterfactuals with Residual Generative Adversarial Nets
- Ethical Considerations in Artificial Intelligence Courses
- Evaluating neural network explanation methods using hybrid documents and morphological agreement
- Private Graph Extraction via Feature Explanations
- A Baseline for Shapley Values in MLPs: from Missingness to Neutrality
- AIR5: Five Pillars of Artificial Intelligence Research
- Learning Fair Rule Lists
- CryptoSPN: Privacy-preserving Sum-Product Network Inference
- Building Trustworthy AI: Transparent AI Systems via Large Language Models, Ontologies, and Logical Reasoning (TranspNet)
- Principles of Explanation in Human-AI Systems
- Beyond Fairness Metrics: Roadblocks and Challenges for Ethical AI in Practice
- MeLIME: Meaningful Local Explanation for Machine Learning Models
- Reasoning on Knowledge Graphs with Debate Dynamics
- Towards Fair Affective Robotics: Continual Learning for Mitigating Bias in Facial Expression and Action Unit Recognition
- NLPGuard: A Framework for Mitigating the Use of Protected Attributes by NLP Classifiers
- The Need for Standardized Explainability
- Ordered Counterfactual Explanation by Mixed-Integer Linear Optimization
- Information Theoretic Measures for Fairness-aware Feature Selection
- RuleMatrix: Visualizing and Understanding Classifiers with Rules
- Exemplary Natural Images Explain CNN Activations Better than State-of-the-Art Feature Visualization
- Towards interpreting ML-based automated malware detection models: a survey
- State of the Art in Fair ML: From Moral Philosophy and Legislation to Fair Classifiers
- Teaching Responsible Data Science: Charting New Pedagogical Territory
- Legal and ethical implications of applications based on agreement technologies: the case of auction-based road intersections
- Explainability in AI Based Applications: A Framework for Comparing Different Techniques
- FovEx: Human-Inspired Explanations for Vision Transformers and Convolutional Neural Networks
- Deep Natural Language Feature Learning for Interpretable Prediction
- Explainable AI and Adoption of Financial Algorithmic Advisors: an Experimental Study
- Safe Handover in Mixed-Initiative Control for Cyber-Physical Systems
- Hows and Whys of Artificial Intelligence for Public Sector Decisions: Explanation and Evaluation
- A Quantitative Perspective on Values of Domain Knowledge for Machine Learning
- Extending LIME for Business Process Automation
- GDPR Anti-Patterns: How Design and Operation of Modern Cloud-scale Systems Conflict with GDPR
- An interpretable semi-supervised classifier using two different strategies for amended self-labeling
- Technologies for Trustworthy Machine Learning: A Survey in a Socio-Technical Context
- Evaluating Neural Machine Comprehension Model Robustness to Noisy Inputs and Adversarial Attacks
- Explaining Natural Language Processing Classifiers with Occlusion and Language Modeling
- GANMEX: One-vs-One Attributions Guided by GAN-based Counterfactual Explanation Baselines
- Supervised Feature Compression based on Counterfactual Analysis
- Preventing the Generation of Inconsistent Sets of Classification Rules
- Measuring and improving the quality of visual explanations
- Optimal Piecewise Local-Linear Approximations
- An Overview on the Landscape of R Packages for Credit Scoring
- Computing Optimal Decision Sets with SAT
- Transparent Classification with Multilayer Logical Perceptrons and Random Binarization
- Debate Dynamics for Human-comprehensible Fact-checking on Knowledge Graphs
- Optimal Explanations of Linear Models
- Training Feedforward Neural Networks with Standard Logistic Activations is Feasible
- A Peek Into the Reasoning of Neural Networks: Interpreting with Structural Visual Concepts
- Cause and Effect: Hierarchical Concept-based Explanation of Neural Networks
- Device-Native Autonomous Agents for Privacy-Preserving Negotiations
- A First Look: Towards Explainable TextVQA Models via Visual and Textual Explanations
- Measure Utility, Gain Trust: Practical Advice for XAI Researcher
- Explainable Automated Coding of Clinical Notes using Hierarchical Label-wise Attention Networks and Label Embedding Initialisation
- "I had a solid theory before but it's falling apart": Polarizing Effects of Algorithmic Transparency
- Interpretable Locally Adaptive Nearest Neighbors
- Providing Explanations for Recommendations in Reciprocal Environments
- "A cold, technical decision-maker": Can AI provide explainability, negotiability, and humanity?
- Player-Centered AI for Automatic Game Personalization: Open Problems
- Towards Interpretable Deep Extreme Multi-label Learning
- Scalable Explanation of Inferences on Large Graphs
- Achieving Transparency Report Privacy in Linear Time
- Exact and Consistent Interpretation of Piecewise Linear Models Hidden behind APIs: A Closed Form Solution
- A copula-based visualization technique for a neural network
- Discovery of Important Subsequences in Electrocardiogram Beats Using the Nearest Neighbour Algorithm
- Probably Approximately Correct Explanations of Machine Learning Models via Syntax-Guided Synthesis
- Explaining a prediction in some nonlinear models
- Robust and Heterogenous Odds Ratio: Estimating Price Sensitivity for Unbought Items
- Towards Explainable Fact Checking
- XPROAX-Local explanations for text classification with progressive neighborhood approximation
- Interpretable ECG classification via a query-based latent space traversal (qLST)
- Paragraph-level Rationale Extraction through Regularization: A case study on European Court of Human Rights Cases
- Footprints of Data in a Classifier: Understanding the Privacy Risks and Solution Strategies
- An Overview of Computational Approaches for Interpretation Analysis
- Maintaining The Humanity of Our Models
- Federated Explainable Artificial Intelligence: Roles, Architectures, Evaluation, and Open Challenges
- A Sparsity Algorithm with Applications to Corporate Credit Rating
- Self-learn to Explain Siamese Networks Robustly