5 citations · 14 across the 11 of their papers we have counts for
11 papers
MIRTH: Mutual-Information Reasoning with Temporal Hubs for Vision-Language-Action Agents
Hao Sun, Yu Song, Shiyu Teng +2
VLA models have emerged as a powerful paradigm for transferring semantic knowledge from web-scale data to physical robotic control. However, current single-frame architectures suff…
SurgFed: Language-guided Multi-Task Federated Learning for Surgical Video Understanding
Zheng Fang, Ziwei Niu, Ziyue Wang +5
Surgical scene Multi-Task Federated Learning (MTFL) is essential for robot-assisted minimally invasive surgery (RAS) but remains underexplored in surgical video understanding due t…
CG-DMER: Hybrid Contrastive-Generative Framework for Disentangled Multimodal ECG Representation Learning
Ziwei Niu, Hao Sun, Shujun Bian +4
Accurate interpretation of electrocardiogram (ECG) signals is crucial for diagnosing cardiovascular diseases. Recent multimodal approaches that integrate ECGs with accompanying cli…
Scalable next-scale autoregression for medical image generation across anatomical regions
Zhicheng He, Yunpeng Zhao, Junde Wu +7
Autoregressive pretraining has been key to the scalability of large language models, yet medical generative foundation models remain predominantly based on diffusion. Here we intro…
EPIC: Efficient Prompt Interaction for Text-Image Classification
Xinyao Yu, Hao Sun, Zeyu Ling +5
In recent years, large-scale pre-trained multimodal models (LMMs) generally emerge to integrate the vision and language modalities, achieving considerable success in multimodal tas…
SemSim: Revisiting Weak-to-Strong Consistency from a Semantic Similarity Perspective for Semi-supervised Medical Image Segmentation
Shiao Xie, Hongyi Wang, Ziwei Niu +4
Semi-supervised learning (SSL) for medical image segmentation is a challenging yet highly practical task, which reduces reliance on large-scale labeled dataset by leveraging unlabe…
HSVLT: Hierarchical Scale-Aware Vision-Language Transformer for Multi-Label Image Classification
Shuyi Ouyang, Hongyi Wang, Ziwei Niu +6
The task of multi-label image classification involves recognizing multiple objects within a single image. Considering both valuable semantic information contained in the labels and…
Spatio-Temporal Fluid Dynamics Modeling via Physical-Awareness and Parameter Diffusion Guidance
Hao Wu, Fan Xu, Yifan Duan +6
This paper proposes a two-stage framework named ST-PAD for spatio-temporal fluid dynamics modeling in the field of earth sciences, aiming to achieve high-precision simulation and p…
A Survey on Domain Generalization for Medical Image Analysis
Ziwei Niu, Shuyi Ouyang, Shiao Xie +2
Medical Image Analysis (MedIA) has emerged as a crucial tool in computer-aided diagnosis systems, particularly with the advancement of deep learning (DL) in recent years. However,…
Memory-Inspired Temporal Prompt Interaction for Text-Image Classification
Xinyao Yu, Hao Sun, Ziwei Niu +4
In recent years, large-scale pre-trained multimodal models (LMM) generally emerge to integrate the vision and language modalities, achieving considerable success in various natural…
Modality-invariant and Specific Prompting for Multimodal Human Perception Understanding
Hao Sun, Ziwei Niu, Xinyao Yu +3
Understanding human perceptions presents a formidable multimodal challenge for computers, encompassing aspects such as sentiment tendencies and sense of humor. While various method…