4 papers
Grounding Clinical AI Competency in Human Cognition Through the Clinical World Model and Skill-Mix Framework
Seyed Amir Ahmad Safavi-Naini, Elahe Meftah, Josh Mohess +11
The competency of any intelligent agent is bounded by its formal account of the world in which it operates. Clinical AI lacks such an account. Existing frameworks address evaluatio…
Large Language Models versus Classical Machine Learning: Performance in COVID-19 Mortality Prediction Using High-Dimensional Tabular Data
Mohammadreza Ghaffarzadeh-Esfahani, Mahdi Ghaffarzadeh-Esfahani, Arian Salahi-Niri +39
This study compared the performance of classical feature-based machine learning models (CMLs) and large language models (LLMs) in predicting COVID-19 mortality using high-dimension…
Vision Language Models versus Machine Learning Models Performance on Polyp Detection and Classification in Colonoscopy Images
Mohammad Amin Khalafi, Seyed Amir Ahmad Safavi-Naini, Ameneh Salehi +13
Introduction: This study provides a comprehensive performance assessment of vision-language models (VLMs) against established convolutional neural networks (CNNs) and classic machi…
Self-Reported Confidence of Large Language Models in Gastroenterology: Analysis of Commercial, Open-Source, and Quantized Models
Nariman Naderi, Seyed Amir Ahmad Safavi-Naini, Thomas Savage +4
This study evaluated self-reported response certainty across several large language models (GPT, Claude, Llama, Phi, Mistral, Gemini, Gemma, and Qwen) using 300 gastroenterology bo…