Artificial mental phenomena: Psychophysics as a framework to detect perception biases in AI models

Abstract

Detecting biases in artificial intelligence has become difficult because of the impenetrable nature of deep learning. The central difficulty is in relating unobservable phenomena deep inside models with observable, outside quantities that we can measure from inputs and outputs. For example, can we detect gendered perceptions of occupations (e.g., female librarian, male electrician) using questions to and answers from a word embedding-based system? Current techniques for detecting biases are often customized for a task, dataset, or method, affecting their generalization. In this work, we draw from Psychophysics in Experimental Psychology---meant to relate quantities from the real world (i.e., "Physics") into subjective measures in the mind (i.e., "Psyche")---to propose an intellectually coherent and generalizable framework to detect biases in AI. Specifically, we adapt the two-alternative forced choice task (2AFC) to estimate potential biases and the strength of those biases in black-box models. We successfully reproduce previously-known biased perceptions in word embeddings and sentiment analysis predictions. We discuss how concepts in experimental psychology can be naturally applied to understanding artificial mental phenomena, and how psychophysics can form a useful methodological foundation to study fairness in AI.

FAT Conference 2020

References in corpus (12)

• EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks
• Semantics derived automatically from language corpora contain human-like biases
• The No-U-Turn Sampler: Adaptively Setting Path Lengths in Hamiltonian Monte Carlo
• Counterfactual Fairness
• Why Is My Classifier Discriminatory?
• Artificial Intelligence and Life in 2030: The One Hundred Year Study on Artificial Intelligence
• Racial categories in machine learning
• Psychlab: A Psychology Laboratory for Deep Reinforcement Learning Agents
• Classification with Fairness Constraints: A Meta-Algorithm with Provable Guarantees
• The Sensitivity of Counterfactual Fairness to Unmeasured Confounding
• Examining Gender and Race Bias in Two Hundred Sentiment Analysis Systems
• Characterizing Bias in Classifiers using Generative Models

Cited by in corpus (1)

• Algorithmic Fairness Datasets: the Story so Far