75 citations · 177 across the 25 of their papers we have counts for
5 papers · 1 filter
A Step Toward Federated Pretraining of Multimodal Large Language Models
Baochen Xiong, Yifan Xu, Xiaoshan Yang +3
The rapid evolution of Multimodal Large Language Models (MLLMs) is bottlenecked by the saturation of high-quality public data, while vast amounts of diverse multimodal data remain…
Harmony: A Unified Framework for Modality Incremental Learning
Yaguang Song, Xiaoshan Yang, Dongmei Jiang +2
Incremental learning aims to enable models to continuously acquire knowledge from evolving data streams while preserving previously learned capabilities. While current research pre…
Pilot: Building the Federated Multimodal Instruction Tuning Framework
Baochen Xiong, Xiaoshan Yang, Yaguang Song +2
In this paper, we explore a novel federated multimodal instruction tuning task(FedMIT), which is significant for collaboratively fine-tuning MLLMs on different types of multimodal…
Health Status Prediction with Local-Global Heterogeneous Behavior Graph
Xuan Ma, Xiaoshan Yang, Junyu Gao +1
Health management is getting increasing attention all over the world. However, existing health management mainly relies on hospital examination and treatment, which are complicated…
Time-Guided High-Order Attention Model of Longitudinal Heterogeneous Healthcare Data
Yi Huang, Xiaoshan Yang, Changsheng Xu
Due to potential applications in chronic disease management and personalized healthcare, the EHRs data analysis has attracted much attention of both researchers and practitioners.…