Aequitas: A Bias and Fairness Audit Toolkit

Abstract

Recent work has raised concerns on the risk of unintended bias in AI systems being used nowadays that can affect individuals unfairly based on race, gender or religion, among other possible characteristics. While a lot of bias metrics and fairness definitions have been proposed in recent years, there is no consensus on which metric/definition should be used and there are very few available resources to operationalize them. Therefore, despite recent awareness, auditing for bias and fairness when developing and deploying AI systems is not yet a standard practice. We present Aequitas, an open source bias and fairness audit toolkit that is an intuitive and easy to use addition to the machine learning workflow, enabling users to seamlessly test models for several bias and fairness metrics in relation to multiple population sub-groups. Aequitas facilitates informed and equitable decisions around developing and deploying algorithmic decision making systems for both data scientists, machine learning researchers and policymakers.

Aequitas website: http://dsapp.uchicago.edu/aequitas

References in corpus (5)

• Equality of Opportunity in Supervised Learning
• Preventing Fairness Gerrymandering: Auditing and Learning for Subgroup Fairness
• AI Fairness 360: An Extensible Toolkit for Detecting, Understanding, and Mitigating Unwanted Algorithmic Bias
• From Parity to Preference-based Notions of Fairness in Classification
• On the relation between accuracy and fairness in binary classification

Cited by in corpus (19)

• Fairness in Machine Learning: A Survey
• Rule Extraction in Unsupervised Anomaly Detection for Model Explainability: Application to OneClass SVM
• Ethics-Based Auditing of Automated Decision-Making Systems: Intervention Points and Policy Implications
• LiFT: A Scalable Framework for Measuring Fairness in ML Applications
• Predictive Multiplicity in Classification
• dalex: Responsible Machine Learning with Interactive Explainability and Fairness in Python
• End-To-End Bias Mitigation: Removing Gender Bias in Deep Learning
• "What We Can't Measure, We Can't Understand": Challenges to Demographic Data Procurement in the Pursuit of Fairness
• BeFair: Addressing Fairness in the Banking Sector
• SoK: Machine Learning Governance
• Bias, Fairness, and Accountability with AI and ML Algorithms
• Addressing multiple metrics of group fairness in data-driven decision making
• A Bandit-Based Algorithm for Fairness-Aware Hyperparameter Optimization
• Fairness and Missing Values
• Progressing Towards Responsible AI
• Faking Fairness via Stealthily Biased Sampling
• Learning from Multiple Noisy Partial Labelers
• Explaining how your AI system is fair
• A Machine Learning System for Retaining Patients in HIV Care