Materiality and Risk in the Age of Pervasive AI Sensors

Abstract

Artificial intelligence (AI) systems connected to sensor-laden devices are becoming pervasive, which has notable implications for a range of AI risks, including to privacy, the environment, autonomy and more. There is therefore a growing need for increased accountability around the responsible development and deployment of these technologies. Here we highlight the dimensions of risk associated with AI systems that arise from the material affordances of sensors and their underlying calculative models. We propose a sensor-sensitive framework for diagnosing these risks, complementing existing approaches such as the US National Institute of Standards and Technology AI Risk Management Framework and the European Union AI Act, and discuss its implementation. We conclude by advocating for increased attention to the materiality of algorithmic systems, and of on-device AI sensors in particular, and highlight the need for development of a sensor design paradigm that empowers users and communities and leads to a future of increased fairness, accountability and transparency.

References in corpus (10)

• Demystifying the Draft EU Artificial Intelligence Act
• Sustainable AI: Environmental Implications, Challenges and Opportunities
• Managing extreme AI risks amid rapid progress
• A Review on Energy Consumption Optimization Techniques in IoT Based Smart Building Environments
• Ethical and social risks of harm from Language Models
• The Algorithmic Imprint
• Anywhere & Everywhere: A Mobile, Immersive, and Ubiquitous Vision for Data Analytics
• Datasheets for Machine Learning Sensors
• A relationship and not a thing: A relational approach to algorithmic accountability and assessment documentation
• TinyML Security: Exploring Vulnerabilities in Resource-Constrained Machine Learning Systems