147 citations · 562 across the 22 of their papers we have counts for
23 papers
The Predictability Bias of Joint-Embedding Predictive Learning in Medical Imaging
Fabian Drexel, Bernhard Kainz, Jakob N. Kather +4
Joint-embedding predictive architectures (JEPAs) learn by predicting teacher representations of masked regions from visible context. Point prediction summarizes the conditional tar…
Hallucination Filtering in Radiology Vision-Language Models Using Discrete Semantic Entropy
Patrick Wienholt, Sophie Caselitz, Robert Siepmann +6
To determine whether using discrete semantic entropy (DSE) to reject questions likely to generate hallucinations can improve the accuracy of black-box vision-language models (VLMs)…
Sex-based Bias Inherent in the Dice Similarity Coefficient: A Model Independent Analysis for Multiple Anatomical Structures
Hartmut Häntze, Myrthe Buser, Alessa Hering +2
Overlap-based metrics such as the Dice Similarity Coefficient (DSC) penalize segmentation errors more heavily in smaller structures. As organ size differs by sex, this implies that…
PARROT: An Open Multilingual Radiology Reports Dataset
Bastien Le Guellec, Kokou Adambounou, Lisa C Adams +85
Rationale and Objectives: To develop and validate PARROT (Polyglottal Annotated Radiology Reports for Open Testing), a large, multicentric, open-access dataset of fictional radiolo…
Multi-step retrieval and reasoning improves radiology question answering with large language models
Sebastian Wind, Jeta Sopa, Daniel Truhn +9
Clinical decision-making in radiology increasingly benefits from artificial intelligence (AI), particularly through large language models (LLMs). However, traditional retrieval-aug…
Improving Reliability and Explainability of Medical Question Answering through Atomic Fact Checking in Retrieval-Augmented LLMs
Juraj Vladika, Annika Domres, Mai Nguyen +10
Large language models (LLMs) exhibit extensive medical knowledge but are prone to hallucinations and inaccurate citations, which pose a challenge to their clinical adoption and reg…
Robust Renal Mass Segmentation on CT: A Validation Study of an AI-Based Framework
Sarah de Boer, Hartmut Häntze, Kiran Vaidhya Venkadesh +9
Renal mass segmentation has important potential to enhance the clinical workflow, especially in settings requiring quantitative assessments. Kidney volume could serve as an importa…
Large Language Models-Enabled Digital Twins for Precision Medicine in Rare Gynecological Tumors
Jacqueline Lammert, Nicole Pfarr, Leonid Kuligin +16
Rare gynecological tumors (RGTs) present major clinical challenges due to their low incidence and heterogeneity. The lack of clear guidelines leads to suboptimal management and poo…
Biomedical Large Languages Models Seem not to be Superior to Generalist Models on Unseen Medical Data
Felix J. Dorfner, Amin Dada, Felix Busch +8
Large language models (LLMs) have shown potential in biomedical applications, leading to efforts to fine-tune them on domain-specific data. However, the effectiveness of this appro…
RadioRAG: Online Retrieval-augmented Generation for Radiology Question Answering
Soroosh Tayebi Arasteh, Mahshad Lotfinia, Keno Bressem +7
Large language models (LLMs) often generate outdated or inaccurate information based on static training datasets. Retrieval-augmented generation (RAG) mitigates this by integrating…
Incorporating Anatomical Awareness for Enhanced Generalizability and Progression Prediction in Deep Learning-Based Radiographic Sacroiliitis Detection
Felix J. Dorfner, Janis L. Vahldiek, Leonhard Donle +15
Purpose: To examine whether incorporating anatomical awareness into a deep learning model can improve generalizability and enable prediction of disease progression. Methods: This r…
MRSegmentator: Multi-Modality Segmentation of 40 Classes in MRI and CT
Hartmut Häntze, Lina Xu, Christian J. Mertens +29
Purpose: To develop and evaluate a deep learning model for multi-organ segmentation of MRI scans. Materials and Methods: The model was trained on 1,200 manually annotated 3D axial…
Improve Cross-Modality Segmentation by Treating T1-Weighted MRI Images as Inverted CT Scans
Hartmut Häntze, Lina Xu, Maximilian Rattunde +5
Computed tomography (CT) segmentation models often contain classes that are not currently supported by magnetic resonance imaging (MRI) segmentation models. In this study, we show…
Is Open-Source There Yet? A Comparative Study on Commercial and Open-Source LLMs in Their Ability to Label Chest X-Ray Reports
Felix J. Dorfner, Liv Jürgensen, Leonhard Donle +11
Introduction: With the rapid advances in large language models (LLMs), there have been numerous new open source as well as commercial models. While recent publications have explore…
LongHealth: A Question Answering Benchmark with Long Clinical Documents
Lisa Adams, Felix Busch, Tianyu Han +7
Background: Recent advancements in large language models (LLMs) offer potential benefits in healthcare, particularly in processing extensive patient records. However, existing benc…
From Text to Image: Exploring GPT-4Vision's Potential in Advanced Radiological Analysis across Subspecialties
Felix Busch, Tianyu Han, Marcus Makowski +3
The study evaluates and compares GPT-4 and GPT-4Vision for radiological tasks, suggesting GPT-4Vision may recognize radiological features from images, thereby enhancing its diagnos…
Medical Foundation Models are Susceptible to Targeted Misinformation Attacks
Tianyu Han, Sven Nebelung, Firas Khader +9
Large language models (LLMs) have broad medical knowledge and can reason about medical information across many domains, holding promising potential for diverse medical applications…
MedAlpaca -- An Open-Source Collection of Medical Conversational AI Models and Training Data
Tianyu Han, Lisa C. Adams, Jens-Michalis Papaioannou +6
As large language models (LLMs) like OpenAI's GPT series continue to make strides, we witness the emergence of artificial intelligence applications in an ever-expanding range of fi…
MEDBERT.de: A Comprehensive German BERT Model for the Medical Domain
Keno K. Bressem, Jens-Michalis Papaioannou, Paul Grundmann +12
This paper presents medBERTde, a pre-trained German BERT model specifically designed for the German medical domain. The model has been trained on a large corpus of 4.7 Million Germ…
Medical Diagnosis with Large Scale Multimodal Transformers: Leveraging Diverse Data for More Accurate Diagnosis
Firas Khader, Gustav Mueller-Franzes, Tianci Wang +9
Multimodal deep learning has been used to predict clinical endpoints and diagnoses from clinical routine data. However, these models suffer from scaling issues: they have to learn…
What Does DALL-E 2 Know About Radiology?
Lisa C. Adams, Felix Busch, Daniel Truhn +3
Generative models such as DALL-E 2 could represent a promising future tool for image generation, augmentation, and manipulation for artificial intelligence research in radiology pr…
3D U-Net for segmentation of COVID-19 associated pulmonary infiltrates using transfer learning: State-of-the-art results on affordable hardware
Keno K. Bressem, Stefan M. Niehues, Bernd Hamm +3
Segmentation of pulmonary infiltrates can help assess severity of COVID-19, but manual segmentation is labor and time-intensive. Using neural networks to segment pulmonary infiltra…
Comparing Different Deep Learning Architectures for Classification of Chest Radiographs
Keno K. Bressem, Lisa Adams, Christoph Erxleben +3
Chest radiographs are among the most frequently acquired images in radiology and are often the subject of computer vision research. However, most of the models used to classify che…