Filling gaps in trustworthy development of AI
arXiv:2112.07773 · doi:10.1126/science.abi7176
Abstract
The range of application of artificial intelligence (AI) is vast, as is the potential for harm. Growing awareness of potential risks from AI systems has spurred action to address those risks, while eroding confidence in AI systems and the organizations that develop them. A 2019 study found over 80 organizations that published and adopted "AI ethics principles'', and more have joined since. But the principles often leave a gap between the "what" and the "how" of trustworthy AI development. Such gaps have enabled questionable or ethically dubious behavior, which casts doubts on the trustworthiness of specific organizations, and the field more broadly. There is thus an urgent need for concrete methods that both enable AI developers to prevent harm and allow them to demonstrate their trustworthiness through verifiable behavior. Below, we explore mechanisms (drawn from arXiv:2004.07213) for creating an ecosystem where AI developers can earn trust - if they are trustworthy. Better assessment of developer trustworthiness could inform user choice, employee actions, investment decisions, legal recourse, and emerging governance regimes.
References in corpus (2)
Cited by in corpus (6)
- Auditing large language models: a three-layered approach
- Predictability and Surprise in Large Generative Models
- Certification Labels for Trustworthy AI: Insights From an Empirical Mixed-Method Study
- Frontier AI developers need an internal audit function
- Advancing Trustworthy AI for Sustainable Development: Recommendations for Standardising AI Incident Reporting
- Incorporating AI incident reporting into telecommunications law and policy: Insights from India