5 papers
MIPS: a Multimodal Infinite Polymer Sequence Pre-training Framework for Polymer Property Prediction
Jiaxi Wang, Yaosen Min, Xun Zhu +2
Polymers, composed of repeating structural units called monomers, are fundamental materials in daily life and industry. Accurate property prediction for polymers is essential for t…
Enhancing Multi-task Learning Capability of Medical Generalist Foundation Model via Image-centric Multi-annotation Data
Xun Zhu, Fanbin Mo, Zheng Zhang +6
The emergence of medical generalist foundation models has revolutionized conventional task-specific model development paradigms, aiming to better handle multiple tasks through join…
MedM-VL: What Makes a Good Medical LVLM?
Yiming Shi, Shaoshuai Yang, Xun Zhu +4
Medical image analysis is essential in modern healthcare. Deep learning has redirected research focus toward complex medical multimodal tasks, including report generation and visua…
Connector-S: A Survey of Connectors in Multi-modal Large Language Models
Xun Zhu, Zheng Zhang, Xi Chen +3
With the rapid advancements in multi-modal large language models (MLLMs), connectors play a pivotal role in bridging diverse modalities and enhancing model performance. However, th…
Med-2E3: A 2D-Enhanced 3D Medical Multimodal Large Language Model
Yiming Shi, Xun Zhu, Kaiwen Wang +4
3D medical image analysis is essential for modern healthcare, yet traditional task-specific models are inadequate due to limited generalizability across diverse clinical scenarios.…