Limits of trust in medical AI

Abstract

Artificial intelligence (AI) is expected to revolutionize the practice of medicine. Recent advancements in the field of deep learning have demonstrated success in a variety of clinical tasks: detecting diabetic retinopathy from images, predicting hospital readmissions, aiding in the discovery of new drugs, etc. AI's progress in medicine, however, has led to concerns regarding the potential effects of this technology upon relationships of trust in clinical practice. In this paper, I will argue that there is merit to these concerns, since AI systems can be relied upon, and are capable of reliability, but cannot be trusted, and are not capable of trustworthiness. Insofar as patients are required to rely upon AI systems for their medical decision-making, there is potential for this to produce a deficit of trust in relationships in clinical practice.

References in corpus (2)

• Massively Multitask Networks for Drug Discovery
• Deep Learning: A Critical Appraisal

Cited by in corpus (4)

• Diachronic and synchronic variation in the performance of adaptive machine learning systems: The ethical challenges
• Are clinicians ethically obligated to disclose their use of medical machine learning systems to patients?
• A moving target in AI-assisted decision-making: Dataset shift, model updating, and the problem of update opacity
• Explainability of Algorithms