activity
20172026
most citedCan GPT-4V(ision) Serve Medical Applications? Case Studies on GPT-4V for Multimodal Medical Diagnosis

46 citations · 167 across the 72 of their papers we have counts for

collaborators
Showing 2024Show all

34 papers · 1 filter

cs.CV2024

How Well Can Modern LLMs Act as Agent Cores in Radiology Environments?

Qiaoyu Zheng, Chaoyi Wu, Weike Zhao +5

Radiology, with its heterogeneous modalities, anatomies, and evolving protocols, is a natural yet high-stakes testbed for agentic AI. As LLMs grow more capable and tool ecosystems…

cs.CV2024

MRGen: Segmentation Data Engine for Underrepresented MRI Modalities

Haoning Wu, Ziheng Zhao, Ya Zhang +2

Training medical image segmentation models for rare yet clinically important imaging modalities is challenging due to the scarcity of annotated data, and manual mask annotations ca…

cs.CV2024★ 1 cited

Towards Universal Soccer Video Understanding

Jiayuan Rao, Haoning Wu, Hao Jiang +3

As a globally celebrated sport, soccer has attracted widespread interest from fans all over the world. This paper aims to develop a comprehensive multi-modal framework for soccer v…

cs.SD2024

A Generalist Audio Foundation Model for Comprehensive Body Sound Auscultation

Pingjie Wang, Liudan Zhao, Zihan Zhao +6

Accurate and efficient auscultation-based diagnostics are vital for early disease detection, especially in resource-limited settings where specialized clinical expertise is scarce.…

cs.CL2024★ 1 cited

CliMedBench: A Large-Scale Chinese Benchmark for Evaluating Medical Large Language Models in Clinical Scenarios

Zetian Ouyang, Yishuai Qiu, Linlin Wang +4

With the proliferation of Large Language Models (LLMs) in diverse domains, there is a particular need for unified evaluation standards in clinical medical scenarios, where models n…

cs.CV2024

LoRKD: Low-Rank Knowledge Decomposition for Medical Foundation Models

Haolin Li, Yuhang Zhou, Ziheng Zhao +5

The widespread adoption of large-scale pre-training techniques has significantly advanced the development of medical foundation models, enabling them to serve as versatile tools ac…

cs.CL2024★ 1 cited

Towards Evaluating and Building Versatile Large Language Models for Medicine

Chaoyi Wu, Pengcheng Qiu, Jinxin Liu +5

In this study, we present MedS-Bench, a comprehensive benchmark designed to evaluate the performance of large language models (LLMs) in clinical contexts. Unlike existing benchmark…

cs.CV2024

Self-supervised Anomaly Detection Pretraining Enhances Long-tail ECG Diagnosis

Aofan Jiang, Chaoqin Huang, Qing Cao +5

Current computer-aided ECG diagnostic systems struggle with the underdetection of rare but critical cardiac anomalies due to the imbalanced nature of ECG datasets. This study intro…

cs.SD2024★ 1 cited

HSDreport: Heart Sound Diagnosis with Echocardiography Reports

Zihan Zhao, Pingjie Wang, Liudan Zhao +7

Heart sound auscultation holds significant importance in the diagnosis of congenital heart disease. However, existing methods for Heart Sound Diagnosis (HSD) tasks are predominantl…

cs.CV2024★ 8 cited

HPC: Hierarchical Progressive Coding Framework for Volumetric Video

Zihan Zheng, Houqiang Zhong, Qiang Hu +4

Volumetric video based on Neural Radiance Field (NeRF) holds vast potential for various 3D applications, but its substantial data volume poses significant challenges for compressio…

cs.CV2024★ 1 cited

MegaFusion: Extend Diffusion Models towards Higher-resolution Image Generation without Further Tuning

Haoning Wu, Shaocheng Shen, Qiang Hu +3

Diffusion models have emerged as frontrunners in text-to-image generation, but their fixed image resolution during training often leads to challenges in high-resolution image gener…

eess.IV2024★ 2 cited

AutoRG-Brain: Grounded Report Generation for Brain MRI

Jiayu Lei, Xiaoman Zhang, Chaoyi Wu +6

Radiologists are tasked with interpreting a large number of images in a daily base, with the responsibility of generating corresponding reports. This demanding workload elevates th…

cs.CV2024

Reprogramming Distillation for Medical Foundation Models

Yuhang Zhou, Siyuan Du, Haolin Li +3

Medical foundation models pre-trained on large-scale datasets have demonstrated powerful versatile capabilities for various tasks. However, due to the gap between pre-training task…

cs.CV2024★ 1 cited

Exploring Training on Heterogeneous Data with Mixture of Low-rank Adapters

Yuhang Zhou, Zihua Zhao, Haolin Li +4

Training a unified model to take multiple targets into account is a trend towards artificial general intelligence. However, how to efficiently mitigate the training conflicts among…

cs.CV2024

JointRF: End-to-End Joint Optimization for Dynamic Neural Radiance Field Representation and Compression

Zihan Zheng, Houqiang Zhong, Qiang Hu +4

Neural Radiance Field (NeRF) excels in photo-realistically static scenes, inspiring numerous efforts to facilitate volumetric videos. However, rendering dynamic and long-sequence r…

cs.LG2024

Diversified Batch Selection for Training Acceleration

Feng Hong, Yueming Lyu, Jiangchao Yao +3

The remarkable success of modern machine learning models on large datasets often demands extensive training time and resource consumption. To save cost, a prevalent research line,…

cs.LG2024

Federated Learning under Partially Class-Disjoint Data via Manifold Reshaping

Ziqing Fan, Jiangchao Yao, Ruipeng Zhang +3

Statistical heterogeneity severely limits the performance of federated learning (FL), motivating several explorations e.g., FedProx, MOON and FedDyn, to alleviate this problem. Des…

cs.CV2024★ 1 cited

Few-Shot Anomaly Detection via Category-Agnostic Registration Learning

Chaoqin Huang, Haoyan Guan, Aofan Jiang +4

Most existing anomaly detection (AD) methods require a dedicated model for each category. Such a paradigm, despite its promising results, is computationally expensive and inefficie…

cs.LG2024★ 1 cited

Federated Learning with Bilateral Curation for Partially Class-Disjoint Data

Ziqing Fan, Ruipeng Zhang, Jiangchao Yao +3

Partially class-disjoint data (PCDD), a common yet under-explored data formation where each client contributes a part of classes (instead of all classes) of samples, severely chall…

cs.LG2024★ 1 cited

Locally Estimated Global Perturbations are Better than Local Perturbations for Federated Sharpness-aware Minimization

Ziqing Fan, Shengchao Hu, Jiangchao Yao +4

In federated learning (FL), the multi-step update and data heterogeneity among clients often lead to a loss landscape with sharper minima, degenerating the performance of the resul…

cs.CV2024★ 2 cited

Domain-Inspired Sharpness-Aware Minimization Under Domain Shifts

Ruipeng Zhang, Ziqing Fan, Jiangchao Yao +2

This paper presents a Domain-Inspired Sharpness-Aware Minimization (DISAM) algorithm for optimization under domain shifts. It is motivated by the inconsistent convergence degree of…

cs.CV2024

Mitigating Noisy Correspondence by Geometrical Structure Consistency Learning

Zihua Zhao, Mengxi Chen, Tianjie Dai +4

Noisy correspondence that refers to mismatches in cross-modal data pairs, is prevalent on human-annotated or web-crawled datasets. Prior approaches to leverage such data mainly con…

cs.CL2024

TAIA: Large Language Models are Out-of-Distribution Data Learners

Shuyang Jiang, Yusheng Liao, Ya Zhang +2

Fine-tuning on task-specific question-answer pairs is a predominant method for enhancing the performance of instruction-tuned large language models (LLMs) on downstream tasks. Howe…

cs.CV2024★ 1 cited

Low-Rank Knowledge Decomposition for Medical Foundation Models

Yuhang Zhou, Haolin Li, Siyuan Du +3

The popularity of large-scale pre-training has promoted the development of medical foundation models. However, some studies have shown that although foundation models exhibit stron…