Transparency, Governance and Regulation of Algorithmic Tools Deployed in the Criminal Justice System: a UK Case Study

Abstract

We present a survey of tools used in the criminal justice system in the UK in three categories: data infrastructure, data analysis, and risk prediction. Many tools are currently in deployment, offering potential benefits, including improved efficiency and consistency. However, there are also important concerns. Transparent information about these tools, their purpose, how they are used, and by whom is difficult to obtain. Even when information is available, it is often insufficient to enable a satisfactory evaluation. More work is needed to establish governance mechanisms to ensure that tools are deployed in a transparent, safe and ethical way. We call for more engagement with stakeholders and greater documentation of the intended goal of a tool, how it will achieve this goal compared to other options, and how it will be monitored in deployment. We highlight additional points to consider when evaluating the trustworthiness of deployed tools and make concrete proposals for policy.

AAAI/ACM Conference on AI, Ethics, and Society 2022

Cited by in corpus (4)

• Harms from Increasingly Agentic Algorithmic Systems
• The Progression of Disparities within the Criminal Justice System: Differential Enforcement and Risk Assessment Instruments
• Formalising Anti-Discrimination Law in Automated Decision Systems
• "Till I can get my satisfaction": Open Questions in the Public Desire to Punish AI