5 papers
The Persona Paradox: Medical Personas as Behavioral Priors in Clinical Language Models
Tassallah Abdullahi, Shrestha Ghosh, Hamish S Fraser +5
Persona conditioning can be viewed as a behavioral prior for large language models (LLMs) and is often assumed to confer expertise and improve safety in a monotonic manner. However…
PiCME: Pipeline for Contrastive Modality Evaluation and Encoding in the MIMIC Dataset
Michal Golovanevsky, Pranav Mahableshwarkar, Carsten Eickhoff +1
Multimodal deep learning holds promise for improving clinical prediction by integrating diverse patient data, including text, imaging, time-series, and structured demographics. Con…
Pixels Versus Priors: Controlling Knowledge Priors in Vision-Language Models through Visual Counterfacts
Michal Golovanevsky, William Rudman, Michael Lepori +3
Multimodal Large Language Models (MLLMs) perform well on tasks such as visual question answering, but it remains unclear whether their reasoning relies more on memorized world know…
Forgotten Polygons: Multimodal Large Language Models are Shape-Blind
William Rudman, Michal Golovanevsky, Amir Bar +4
Despite strong performance on vision-language tasks, Multimodal Large Language Models (MLLMs) struggle with mathematical problem-solving, with both open-source and state-of-the-art…
K-Paths: Reasoning over Graph Paths for Drug Repurposing and Drug Interaction Prediction
Tassallah Abdullahi, Ioanna Gemou, Nihal V. Nayak +4
Biomedical knowledge graphs (KGs) encode rich, structured information critical for drug discovery tasks, but extracting meaningful insights from large-scale KGs remains challenging…