Algorithmic Auditing and Social Justice: Lessons from the History of Audit Studies
arXiv:2109.06974 · doi:10.1145/3465416.3483294
Abstract
Algorithmic audits have been embraced as tools to investigate the functioning and consequences of sociotechnical systems. Though the term is used somewhat loosely in the algorithmic context and encompasses a variety of methods, it maintains a close connection to audit studies in the social sciences--which have, for decades, used experimental methods to measure the prevalence of discrimination across domains like housing and employment. In the social sciences, audit studies originated in a strong tradition of social justice and participatory action, often involving collaboration between researchers and communities; but scholars have argued that, over time, social science audits have become somewhat distanced from these original goals and priorities. We draw from this history in order to highlight difficult tensions that have shaped the development of social science audits, and to assess their implications in the context of algorithmic auditing. In doing so, we put forth considerations to assist in the development of robust and engaged assessments of sociotechnical systems that draw from auditing's roots in racial equity and social justice.
References in corpus (1)
Cited by in corpus (6)
- Who Audits the Auditors? Recommendations from a field scan of the algorithmic auditing ecosystem
- Certification Labels for Trustworthy AI: Insights From an Empirical Mixed-Method Study
- How Algorithms Shape the Distribution of Political Advertising: Case Studies of Facebook, Google, and TikTok
- Making the Unaccountable Internet: The Changing Meaning of Accounting in the Early ARPANET
- Leave no Place Behind: Improved Geolocation in Humanitarian Documents
- Strategic Evaluation: Subjects, Evaluators, and Society