1 citations · 1 across the 11 of their papers we have counts for
Showing 2024Show all
2 papers · 1 filter
cs.CV2024
Accelerating Pre-training of Multimodal LLMs via Chain-of-Sight
Ziyuan Huang, Kaixiang Ji, Biao Gong +6
This paper introduces Chain-of-Sight, a vision-language bridge module that accelerates the pre-training of Multimodal Large Language Models (MLLMs). Our approach employs a sequence…
cs.LG2024
OrchMoE: Efficient Multi-Adapter Learning with Task-Skill Synergy
Haowen Wang, Tao Sun, Kaixiang Ji +3
We advance the field of Parameter-Efficient Fine-Tuning (PEFT) with our novel multi-adapter method, OrchMoE, which capitalizes on modular skill architecture for enhanced forward tr…