2 papers
cs.AI2026
Reallocating Attention Across Layers to Reduce Multimodal Hallucination
Haolang Lu, Bolun Chu, WeiYe Fu +7
Multimodal large reasoning models (MLRMs) often suffer from hallucinations that stem not only from insufficient visual grounding but also from imbalanced allocation between percept…
cs.CL2026
Advancing Expert Specialization for Better MoE
Hongcan Guo, Haolang Lu, Guoshun Nan +8
Mixture-of-Experts (MoE) models enable efficient scaling of large language models (LLMs) by activating only a subset of experts per input. However, we observe that the commonly use…