4 papers
Unlocking Multilingual Reasoning Capability of LLMs and LVLMs through Representation Engineering
Qiming Li, Xiaocheng Feng, Yixuan Ma +4
Large Language Models (LLMs) and Large Vision-Language Models (LVLMs) demonstrate strong reasoning capabilities, yet their performance in English significantly outperforms that in…
Learning to See through Illumination Extremes with Event Streaming in Multimodal Large Language Models
Baoheng Zhang, Jiahui Liu, Gui Zhao +7
Multimodal Large Language Models (MLLMs) perform strong vision-language reasoning under standard conditions but fail in extreme illumination, where RGB inputs lose irrevocable stru…
State Rank Dynamics in Linear Attention LLMs
Ao Sun, Hongtao Zhang, Heng Zhou +9
Linear Attention Large Language Models (LLMs) offer a compelling recurrent formulation that compresses context into a fixed-size state matrix, enabling constant-time inference. How…
Information Gain-Guided Causal Intervention for Autonomous Debiasing Large Language Models
Zhouhao Sun, Xiao Ding, Li Du +5
Despite significant progress, recent studies indicate that current large language models (LLMs) may still capture dataset biases and utilize them during inference, leading to the p…