Fairness for Unobserved Characteristics: Insights from Technological Impacts on Queer Communities

Abstract

Advances in algorithmic fairness have largely omitted sexual orientation and gender identity. We explore queer concerns in privacy, censorship, language, online safety, health, and employment to study the positive and negative effects of artificial intelligence on queer communities. These issues underscore the need for new directions in fairness research that take into account a multiplicity of considerations, from privacy preservation, context sensitivity and process fairness, to an awareness of sociotechnical impact and the increasingly important role of inclusive and participatory research processes. Most current approaches for algorithmic fairness assume that the target characteristics for fairness--frequently, race and legal gender--can be observed or recorded. Sexual orientation and gender identity are prototypical instances of unobserved characteristics, which are frequently missing, unknown or fundamentally unmeasurable. This paper highlights the importance of developing new approaches for algorithmic fairness that break away from the prevailing assumption of observed characteristics.

arXiv commentProceedings of the 2021 AAAI/ACM Conference on AI, Ethics, and Society (AIES 2021)

References in corpus (4)

• Towards a Critical Race Methodology in Algorithmic Fairness
• A Reinforcement Learning System to Encourage Physical Activity in Diabetes Patients
• Awareness in Practice: Tensions in Access to Sensitive Attribute Data for Antidiscrimination
• Adversarial Privacy-preserving Filter

Cited by in corpus (9)

• Responsible and Regulatory Conform Machine Learning for Medicine: A Survey of Challenges and Solutions
• Inherent Limitations of AI Fairness
• Examining the Unique Online Risk Experiences and Mental Health Outcomes of LGBTQ+ versus Heterosexual Youth
• LLM-Driven Robots Risk Enacting Discrimination, Violence, and Unlawful Actions
• Human participants in AI research: Ethics and transparency in practice
• Group fairness without demographics using social networks
• Identities are not Interchangeable: The Problem of Overgeneralization in Fair Machine Learning
• Recourse for reclamation: Chatting with generative language models
• Social and Ethical Risks Posed by General-Purpose LLMs for Settling Newcomers in Canada