activity
20212024
most citedEvaluation of ChatGPT Family of Models for Biomedical Reasoning and Classification

77 citations · 105 across the 7 of their papers we have counts for

collaborators

10 papers

cs.CL2024

ClinicalBench: Can LLMs Beat Traditional ML Models in Clinical Prediction?

Canyu Chen, Jian Yu, Shan Chen +8

Large Language Models (LLMs) hold great promise to revolutionize current clinical systems for their superior capacities on medical text processing tasks and medical licensing exams…

cs.CL2024

Wait, but Tylenol is Acetaminophen... Investigating and Improving Language Models' Ability to Resist Requests for Misinformation

Shan Chen, Mingye Gao, Kuleen Sasse +6

Background: Large language models (LLMs) are trained to follow directions, but this introduces a vulnerability to blindly comply with user requests even if they generate wrong info…

cs.CL2024★ 7 cited

Simulated patient systems powered by large language model-based AI agents offer potential for transforming medical education

Huizi Yu, Jiayan Zhou, Lingyao Li +22

Background: Simulated patient systems are important in medical education and research, providing safe, integrative training environments and supporting clinical decision making. Ad…

cs.CL2024

Cross-Care: Assessing the Healthcare Implications of Pre-training Data on Language Model Bias

Shan Chen, Jack Gallifant, Mingye Gao +12

Large language models (LLMs) are increasingly essential in processing natural languages, yet their application is frequently compromised by biases and inaccuracies originating in t…

cs.CL2024★ 1 cited

Language Models are Surprisingly Fragile to Drug Names in Biomedical Benchmarks

Jack Gallifant, Shan Chen, Pedro Moreira +7

Medical knowledge is context-dependent and requires consistent reasoning across various natural language expressions of semantically equivalent phrases. This is particularly crucia…

cs.CL2023

Measuring Pointwise -Usable Information In-Context-ly

Sheng Lu, Shan Chen, Yingya Li +3

In-context learning (ICL) is a new learning paradigm that has gained popularity along with the development of large language models. In this work, we adapt a recently proposed hard…

cs.CL2023

Large Language Models to Identify Social Determinants of Health in Electronic Health Records

Marco Guevara, Shan Chen, Spencer Thomas +11

Social determinants of health (SDoH) have an important impact on patient outcomes but are incompletely collected from the electronic health records (EHR). This study researched the…

cs.CL2023★ 77 cited

Evaluation of ChatGPT Family of Models for Biomedical Reasoning and Classification

Shan Chen, Yingya Li, Sheng Lu +4

Recent advances in large language models (LLMs) have shown impressive ability in biomedical question-answering, but have not been adequately investigated for more specific biomedic…

cs.CL2023★ 19 cited

Natural language processing to automatically extract the presence and severity of esophagitis in notes of patients undergoing radiotherapy

Shan Chen, Marco Guevara, Nicolas Ramirez +7

Radiotherapy (RT) toxicities can impair survival and quality-of-life, yet remain under-studied. Real-world evidence holds potential to improve our understanding of toxicities, but…

cs.CL2021★ 1 cited

BCH-NLP at BioCreative VII Track 3: medications detection in tweets using transformer networks and multi-task learning

Dongfang Xu, Shan Chen, Timothy Miller

In this paper, we present our work participating in the BioCreative VII Track 3 - automatic extraction of medication names in tweets, where we implemented a multi-task learning mod…