Automated Radiology Report Generation: A Review of Recent Advances

Abstract

Increasing demands on medical imaging departments are taking a toll on the radiologist's ability to deliver timely and accurate reports. Recent technological advances in artificial intelligence have demonstrated great potential for automatic radiology report generation (ARRG), sparking an explosion of research. This survey paper conducts a methodological review of contemporary ARRG approaches by way of (i) assessing datasets based on characteristics, such as availability, size, and adoption rate, (ii) examining deep learning training methods, such as contrastive learning and reinforcement learning, (iii) exploring state-of-the-art model architectures, including variations of CNN and transformer models, (iv) outlining techniques integrating clinical knowledge through multimodal inputs and knowledge graphs, and (v) scrutinising current model evaluation techniques, including commonly applied NLP metrics and qualitative clinical reviews. Furthermore, the quantitative results of the reviewed models are analysed, where the top performing models are examined to seek further insights. Finally, potential new directions are highlighted, with the adoption of additional datasets from other radiological modalities and improved evaluation methods predicted as important areas of future development.

24 pages, 8 figures, 6 tables. Accepted by IEEE Reviews in Biomedical Engineering

References in corpus (11)

• Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing
• A review of deep learning in medical imaging: Imaging traits, technology trends, case studies with progress highlights, and future promises
• Making the Most of Text Semantics to Improve Biomedical Vision--Language Processing
• Knowledge Matters: Radiology Report Generation with General and Specific Knowledge
• Multi-modal Understanding and Generation for Medical Images and Text via Vision-Language Pre-Training
• Interactive and Explainable Region-guided Radiology Report Generation
• Improving Chest X-Ray Report Generation by Leveraging Warm Starting
• Medical-VLBERT: Medical Visual Language BERT for COVID-19 CT Report Generation With Alternate Learning
• Can GPT-4V(ision) Serve Medical Applications? Case Studies on GPT-4V for Multimodal Medical Diagnosis
• RepsNet: Combining Vision with Language for Automated Medical Reports
• Controllable Chest X-Ray Report Generation from Longitudinal Representations