5 papers
Patient-Level Multimodal Question Answering from Multi-Site Auscultation Recordings
Fan Wu, Tsai-Ning Wang, Nicolas Zumarraga +8
Auscultation is a vital diagnostic tool, yet its utility is often limited by subjective interpretation. While general-purpose Audio-Language Models (ALMs) excel in general domains,…
How Well Do Multimodal Models Reason on ECG Signals?
Maxwell A. Xu, Harish Haresamudram, Catherine W. Liu +11
While multimodal large language models offer a promising solution to the "black box" nature of health AI by generating interpretable reasoning traces, verifying the validity of the…
EvoMorph: Counterfactual Explanations for Continuous Time-Series Extrinsic Regression Applied to Photoplethysmography
Mesut Ceylan, Alexis Tabin, Patrick Langer +2
Wearable devices enable continuous, population-scale monitoring of physiological signals, such as photoplethysmography (PPG), creating new opportunities for data-driven clinical as…
OpenTSLM: Time-Series Language Models for Reasoning over Multivariate Medical Text- and Time-Series Data
Patrick Langer, Thomas Kaar, Max Rosenblattl +19
LLMs have emerged as powerful tools for interpreting multimodal data. In medicine, they hold particular promise for synthesizing large volumes of clinical information into actionab…
Digital Scale: Open-Source On-Device BMI Estimation from Smartphone Camera Images Trained on a Large-Scale Real-World Dataset
Frederik Rajiv Manichand, Robin Deuber, Robert Jakob +4
Estimating Body Mass Index (BMI) from camera images with machine learning models enables rapid weight assessment when traditional methods are unavailable or impractical, such as in…