2 papers
cs.CL2024
MLAN: Language-Based Instruction Tuning Preserves and Transfers Knowledge in Multimodal Language Models
Jianhong Tu, Zhuohao Ni, Nicholas Crispino +8
We present a novel visual instruction tuning strategy to improve the zero-shot task generalization of multimodal large language models by building a firm text-only knowledge base.…
q-bio.NC2024
Learnable Community-Aware Transformer for Brain Connectome Analysis with Token Clustering
Yanting Yang, Beidi Zhao, Zhuohao Ni +2
Neuroscientific research has revealed that the complex brain network can be organized into distinct functional communities, each characterized by a cohesive group of regions of int…