Artificial General Intelligence for Medical Imaging Analysis

Abstract

Large-scale Artificial General Intelligence (AGI) models, including Large Language Models (LLMs) such as ChatGPT/GPT-4, have achieved unprecedented success in a variety of general domain tasks. Yet, when applied directly to specialized domains like medical imaging, which require in-depth expertise, these models face notable challenges arising from the medical field's inherent complexities and unique characteristics. In this review, we delve into the potential applications of AGI models in medical imaging and healthcare, with a primary focus on LLMs, Large Vision Models, and Large Multimodal Models. We provide a thorough overview of the key features and enabling techniques of LLMs and AGI, and further examine the roadmaps guiding the evolution and implementation of AGI models in the medical sector, summarizing their present applications, potentialities, and associated challenges. In addition, we highlight potential future research directions, offering a holistic view on upcoming ventures. This comprehensive review aims to offer insights into the future implications of AGI in medical imaging, healthcare, and beyond.

References in corpus (17)

• The Future of Digital Health with Federated Learning
• Segment Anything in Medical Images
• Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing
• Medical Image Analysis using Convolutional Neural Networks: A Review
• TransMorph: Transformer for unsupervised medical image registration
• Summary of ChatGPT-Related Research and Perspective Towards the Future of Large Language Models
• Segment Anything Model for Medical Image Analysis: an Experimental Study
• Segment Anything Model for Medical Images?
• MedViT: A Robust Vision Transformer for Generalized Medical Image Classification
• BiomedGPT: A Generalist Vision-Language Foundation Model for Diverse Biomedical Tasks
• Foundation Models for Time Series Analysis: A Tutorial and Survey
• Evaluating Large Language Models on a Highly-specialized Topic, Radiation Oncology Physics
• Generalist Vision Foundation Models for Medical Imaging: A Case Study of Segment Anything Model on Zero-Shot Medical Segmentation
• An Iterative Optimizing Framework for Radiology Report Summarization with ChatGPT
• Using generative AI to investigate medical imagery models and datasets
• Embedded Visual Prompt Tuning
• Holistically Explainable Vision Transformers

Cited by in corpus (2)

• Unveiling the frontiers of deep learning: innovations shaping diverse domains
• A recent evaluation on the performance of LLMs on radiation oncology physics using questions of randomly shuffled options