activity
20192026
most citedLLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Day

231 citations · 465 across the 19 of their papers we have counts for

collaborators

19 papers

cs.CV2026

GigaPath-Flash and GigaTIME-Flash: Efficient Pathology Foundation Models for Whole-Slide and Tumor Microenvironment Analysis

Naoto Usuyama, Jeya Maria Jose Valanarasu, Sicong Yao +27

Foundation models have emerged as a driving force in computational pathology, with the potential to transform cancer diagnosis, prognosis, and treatment selection by learning trans…

cs.AI2026

HealthAgentBench: A Unified Benchmark Suite of Realistic Agentic Healthcare Environments for Challenging Frontier AI Agents

Qianchu Liu, Sheng Zhang, Guanghui Qin +16

As AI agents become increasingly capable of complex, long-horizon reasoning, rigorous and holistic evaluation is essential for measuring progress toward real-world healthcare appli…

cs.AI2025★ 1 cited

The Illusion of Readiness in Health AI

Yu Gu, Jingjing Fu, Xiaodong Liu +29

Large language models have demonstrated remarkable performance in a wide range of medical benchmarks. Yet underneath the seemingly promising results lie salient growth areas, espec…

cs.LG2025

CancerGUIDE: Cancer Guideline Understanding via Internal Disagreement Estimation

Alyssa Unell, Noel C. F. Codella, Sam Preston +13

The National Comprehensive Cancer Network (NCCN) provides evidence-based guidelines for cancer treatment. Translating complex patient presentations into guideline-compliant treatme…

cs.LG2025★ 3 cited

Generative Medical Event Models Improve with Scale

Shane Waxler, Paul Blazek, Davis White +16

Realizing personalized medicine at scale calls for methods that distill insights from longitudinal patient journeys, which can be viewed as a sequence of medical events. Foundation…

cs.CL2025

Exploring Scaling Laws for EHR Foundation Models

Sheng Zhang, Qin Liu, Naoto Usuyama +3

The emergence of scaling laws has profoundly shaped the development of large language models (LLMs), enabling predictable performance gains through systematic increases in model si…

cs.CL2025★ 1 cited

Universal Abstraction: Harnessing Frontier Models to Structure Real-World Data at Scale

Cliff Wong, Sam Preston, Qianchu Liu +22

A significant fraction of real-world patient information resides in unstructured clinical text. Medical abstraction extracts and normalizes key structured attributes from free-text…

cs.CL2024★ 40 cited

Towards a clinically accessible radiology foundation model: open-access and lightweight, with automated evaluation

Juan Manuel Zambrano Chaves, Shih-Cheng Huang, Yanbo Xu +24

The scaling laws and extraordinary performance of large foundation models motivate the development and utilization of such models in biomedicine. However, despite early promising r…

cs.CV2024★ 14 cited

Foundation Models for Biomedical Image Segmentation: A Survey

Ho Hin Lee, Yu Gu, Theodore Zhao +9

Recent advancements in biomedical image analysis have been significantly driven by the Segment Anything Model (SAM). This transformative technology, originally developed for genera…

cs.CL2023★ 1 cited

DocLens: Multi-aspect Fine-grained Evaluation for Medical Text Generation

Yiqing Xie, Sheng Zhang, Hao Cheng +6

Medical text generation aims to assist with administrative work and highlight salient information to support decision-making. To reflect the specific requirements of medical text,…

cs.LG2023★ 2 cited

TRIALSCOPE: A Unifying Causal Framework for Scaling Real-World Evidence Generation with Biomedical Language Models

Javier González, Risa Ueno, Cliff Wong +12

The rapid digitization of real-world data presents an unprecedented opportunity to optimize healthcare delivery and accelerate biomedical discovery. However, these data are often f…

cs.CL2023★ 27 cited

Scaling Clinical Trial Matching Using Large Language Models: A Case Study in Oncology

Cliff Wong, Sheng Zhang, Yu Gu +8

Clinical trial matching is a key process in health delivery and discovery. In practice, it is plagued by overwhelming unstructured data and unscalable manual processing. In this pa…

cs.CL2023★ 16 cited

Distilling Large Language Models for Biomedical Knowledge Extraction: A Case Study on Adverse Drug Events

Yu Gu, Sheng Zhang, Naoto Usuyama +8

Large language models (LLMs), such as GPT-4, have demonstrated remarkable capabilities across a wide range of tasks, including health applications. In this paper, we study how LLMs…

cs.CV2023★ 231 cited

LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Day

Chunyuan Li, Cliff Wong, Sheng Zhang +6

Conversational generative AI has demonstrated remarkable promise for empowering biomedical practitioners, but current investigations focus on unimodal text. Multimodal conversation…

cs.CV2023★ 102 cited

BiomedCLIP: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairs

Sheng Zhang, Yanbo Xu, Naoto Usuyama +21

Biomedical data is inherently multimodal, comprising physical measurements and natural language narratives. A generalist biomedical AI model needs to simultaneously process differe…

cs.CL2021★ 2 cited

Knowledge-Rich Self-Supervision for Biomedical Entity Linking

Sheng Zhang, Hao Cheng, Shikhar Vashishth +6

Entity linking faces significant challenges such as prolific variations and prevalent ambiguities, especially in high-value domains with myriad entities. Standard classification ap…

cs.CL2021

Modular Self-Supervision for Document-Level Relation Extraction

Sheng Zhang, Cliff Wong, Naoto Usuyama +3

Extracting relations across large text spans has been relatively underexplored in NLP, but it is particularly important for high-value domains such as biomedicine, where obtaining…

cs.IR2021★ 12 cited

Domain-Specific Pretraining for Vertical Search: Case Study on Biomedical Literature

Yu Wang, Jinchao Li, Tristan Naumann +12

Information overload is a prevalent challenge in many high-value domains. A prominent case in point is the explosion of the biomedical literature on COVID-19, which swelled to hund…

cs.CL2019★ 13 cited

Document-Level -ary Relation Extraction with Multiscale Representation Learning

Robin Jia, Cliff Wong, Hoifung Poon

Most information extraction methods focus on binary relations expressed within single sentences. In high-value domains, however, -ary relations are of great demand (e.g., drug-g…