MedAlpaca -- An Open-Source Collection of Medical Conversational AI Models and Training Data

Abstract

As large language models (LLMs) like OpenAI's GPT series continue to make strides, we witness the emergence of artificial intelligence applications in an ever-expanding range of fields. In medicine, these LLMs hold considerable promise for improving medical workflows, diagnostics, patient care, and education. Yet, there is an urgent need for open-source models that can be deployed on-premises to safeguard patient privacy. In our work, we present an innovative dataset consisting of over 160,000 entries, specifically crafted to fine-tune LLMs for effective medical applications. We investigate the impact of fine-tuning these datasets on publicly accessible pre-trained LLMs, and subsequently, we juxtapose the performance of pre-trained-only models against the fine-tuned models concerning the examinations that future medical doctors must pass to achieve certification.

Cited by in corpus (12)

• Adapted Large Language Models Can Outperform Medical Experts in Clinical Text Summarization
• Opportunities and Challenges for ChatGPT and Large Language Models in Biomedicine and Health
• Vision-Language Models for Medical Report Generation and Visual Question Answering: A Review
• Automated data processing and feature engineering for deep learning and big data applications: a survey
• Generative AI for Synthetic Data Across Multiple Medical Modalities: A Systematic Review of Recent Developments and Challenges
• A Comprehensive Survey of Large Language Models and Multimodal Large Language Models in Medicine
• ChatCAD+: Towards a Universal and Reliable Interactive CAD using LLMs
• MedExpQA: Multilingual Benchmarking of Large Language Models for Medical Question Answering
• From large language models to multimodal AI: A scoping review on the potential of generative AI in medicine
• Clinical Insights: A Comprehensive Review of Language Models in Medicine
• REMONI: An Autonomous System Integrating Wearables and Multimodal Large Language Models for Enhanced Remote Health Monitoring
• MedDoc-Bot: A Chat Tool for Comparative Analysis of Large Language Models in the Context of the Pediatric Hypertension Guideline