activity
20202023
most citedDomain-Specific Language Model Pretraining for Biomedical Natural Language Processing

2.2k citations · 2.3k across the 6 of their papers we have counts for

collaborators

6 papers

cs.CL2023★ 27 cited

Scaling Clinical Trial Matching Using Large Language Models: A Case Study in Oncology

Cliff Wong, Sheng Zhang, Yu Gu +8

Clinical trial matching is a key process in health delivery and discovery. In practice, it is plagued by overwhelming unstructured data and unscalable manual processing. In this pa…

cs.CL2023★ 26 cited

UniversalNER: Targeted Distillation from Large Language Models for Open Named Entity Recognition

Wenxuan Zhou, Sheng Zhang, Yu Gu +2

Large language models (LLMs) have demonstrated remarkable generalizability, such as understanding arbitrary entities and relations. Instruction tuning has proven effective for dist…

cs.CL2023★ 16 cited

Distilling Large Language Models for Biomedical Knowledge Extraction: A Case Study on Adverse Drug Events

Yu Gu, Sheng Zhang, Naoto Usuyama +8

Large language models (LLMs), such as GPT-4, have demonstrated remarkable capabilities across a wide range of tasks, including health applications. In this paper, we study how LLMs…

cs.CL2022★ 3 cited

Towards Structuring Real-World Data at Scale: Deep Learning for Extracting Key Oncology Information from Clinical Text with Patient-Level Supervision

Sam Preston, Mu Wei, Rajesh Rao +11

Objective: The majority of detailed patient information in real-world data (RWD) is only consistently available in free-text clinical documents. Manual curation is expensive and ti…

cs.CL2021★ 17 cited

Fine-Tuning Large Neural Language Models for Biomedical Natural Language Processing

Robert Tinn, Hao Cheng, Yu Gu +5

Motivation: A perennial challenge for biomedical researchers and clinical practitioners is to stay abreast with the rapid growth of publications and medical notes. Natural language…

cs.CL2020★ 2.2k cited

Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing

Yu Gu, Robert Tinn, Hao Cheng +6

Pretraining large neural language models, such as BERT, has led to impressive gains on many natural language processing (NLP) tasks. However, most pretraining efforts focus on gene…