8 papers
Keeping an Eye on AI: A Framework for Effective Human Oversight of AI Systems
Susanne Gaube, Markus Langer, Tim Miller +17
The use of Artificial Intelligence (AI) in high-risk, decision-making scenarios presents technical, safety, and normative challenges; problems that may only be ameliorated by human…
From Universal to Individualized Actionability: Revisiting Personalization in Algorithmic Recourse
Lena Marie Budde, Ayan Majumdar, Richard Uth +2
Algorithmic recourse aims to provide actionable recommendations that enable individuals to change unfavorable model outcomes, and prior work has extensively studied properties such…
Secure human oversight of AI: Threat modeling in a socio-technical context
Jonas C. Ditz, Veronika Lazar, Elmar Lichtmeà +4
Human oversight of AI is promoted as a safeguard against risks such as inaccurate outputs, system malfunctions, or violations of fundamental rights, and is mandated in regulation l…
Don't blame me: How Intelligent Support Affects Moral Responsibility in Human Oversight
Cedric Faas, Richard Uth, Sarah Sterz +2
AI-based systems can increasingly perform work tasks autonomously. In safety-critical tasks, human oversight of these systems is required to mitigate risks and to ensure responsibi…
Design Considerations for Human Oversight of AI: Insights from Co-Design Workshops and Work Design Theory
Cedric Faas, Sophie Kerstan, Richard Uth +2
As AI systems become increasingly capable and autonomous, domain experts' roles are shifting from performing tasks themselves to overseeing AI-generated outputs. Such oversight is…
On the Complexities of Testing for Compliance with Human Oversight Requirements in AI Regulation
Markus Langer, Veronika Lazar, Kevin Baum
Human oversight requirements are a core component of the European AI Act and in AI governance. In this paper, we highlight key challenges in testing for compliance with these requi…