activity
20202023
most citedDomain-Specific Language Model Pretraining for Biomedical Natural Language Processing

2.2k citations · 2.3k across the 6 of their papers we have counts for

collaborators

6 papers

cs.CL2023★ 2 cited

Exploring the Boundaries of GPT-4 in Radiology

Qianchu Liu, Stephanie Hyland, Shruthi Bannur +16

The recent success of general-domain large language models (LLMs) has significantly changed the natural language processing paradigm towards a unified foundation model across domai…

cs.CV2023★ 102 cited

BiomedCLIP: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairs

Sheng Zhang, Yanbo Xu, Naoto Usuyama +21

Biomedical data is inherently multimodal, comprising physical measurements and natural language narratives. A generalist biomedical AI model needs to simultaneously process differe…

cs.CL2022★ 3 cited

Towards Structuring Real-World Data at Scale: Deep Learning for Extracting Key Oncology Information from Clinical Text with Patient-Level Supervision

Sam Preston, Mu Wei, Rajesh Rao +11

Objective: The majority of detailed patient information in real-world data (RWD) is only consistently available in free-text clinical documents. Manual curation is expensive and ti…

cs.CL2021★ 17 cited

Fine-Tuning Large Neural Language Models for Biomedical Natural Language Processing

Robert Tinn, Hao Cheng, Yu Gu +5

Motivation: A perennial challenge for biomedical researchers and clinical practitioners is to stay abreast with the rapid growth of publications and medical notes. Natural language…

cs.IR2021★ 12 cited

Domain-Specific Pretraining for Vertical Search: Case Study on Biomedical Literature

Yu Wang, Jinchao Li, Tristan Naumann +12

Information overload is a prevalent challenge in many high-value domains. A prominent case in point is the explosion of the biomedical literature on COVID-19, which swelled to hund…

cs.CL2020★ 2.2k cited

Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing

Yu Gu, Robert Tinn, Hao Cheng +6

Pretraining large neural language models, such as BERT, has led to impressive gains on many natural language processing (NLP) tasks. However, most pretraining efforts focus on gene…