Showing cs.AIShow all
2 papers · 1 filter
cs.AI2026
Function Over Form: Distributional Orthogonalization in Mixture-of-Experts with Replica Expert Mechanism
Jinfan He, Yunzhuo Liu, Kai Zhang +3
The scaling of LLMs increasingly relies on MoE architectures to decouple active computation from total parameter count. However, the efficacy of MoE is often constrained by expert…
cs.AI2024
VisLingInstruct: Elevating Zero-Shot Learning in Multi-Modal Language Models with Autonomous Instruction Optimization
Dongsheng Zhu, Xunzhu Tang, Weidong Han +5
This paper presents VisLingInstruct, a novel approach to advancing Multi-Modal Language Models (MMLMs) in zero-shot learning. Current MMLMs show impressive zero-shot abilities in m…