Characterizing Bias in Classifiers using Generative Models

Abstract

Models that are learned from real-world data are often biased because the data used to train them is biased. This can propagate systemic human biases that exist and ultimately lead to inequitable treatment of people, especially minorities. To characterize bias in learned classifiers, existing approaches rely on human oracles labeling real-world examples to identify the "blind spots" of the classifiers; these are ultimately limited due to the human labor required and the finite nature of existing image examples. We propose a simulation-based approach for interrogating classifiers using generative adversarial models in a systematic manner. We incorporate a progressive conditional generative model for synthesizing photo-realistic facial images and Bayesian Optimization for an efficient interrogation of independent facial image classification systems. We show how this approach can be used to efficiently characterize racial and gender biases in commercial systems.

References in corpus (13)

• Conditional Generative Adversarial Nets
• Practical Bayesian Optimization of Machine Learning Algorithms
• A Tutorial on Bayesian Optimization of Expensive Cost Functions, with Application to Active User Modeling and Hierarchical Reinforcement Learning
• The Space of Transferable Adversarial Examples
• LR-GAN: Layered Recursive Generative Adversarial Networks for Image Generation
• Predictive Inequity in Object Detection
• Unsupervised Image-to-Image Translation with Generative Adversarial Networks
• Robustness of Conditional GANs to Noisy Labels
• Identifying Unknown Unknowns in the Open World: Representations and Policies for Guided Exploration
• Identifying Bias in AI using Simulation
• Model-driven Simulations for Deep Convolutional Neural Networks
• Simulations for Validation of Vision Systems
• Model Validation for Vision Systems via Graphics Simulation

Cited by in corpus (4)

• ET-AL: Entropy-Targeted Active Learning for Bias Mitigation in Materials Data
• Skin Deep: Investigating Subjectivity in Skin Tone Annotations for Computer Vision Benchmark Datasets
• Artificial mental phenomena: Psychophysics as a framework to detect perception biases in AI models
• Quality-Diversity Generative Sampling for Learning with Synthetic Data