Showing cs.CLShow all
2 papers · 1 filter
cs.CL2026
Lngram: N-gram Conditional Memory in Latent Space
Yunao Zheng, Guoyang Xia, Xiaojie Wang +1
Sequence modeling requires both compositional reasoning and local static knowledge retrieval, yet standard Transformers handle both through dense computation. Engram partially deco…
cs.CL2025
SMAR: Soft Modality-Aware Routing Strategy for MoE-based Multimodal Large Language Models Preserving Language Capabilities
Guoyang Xia, Yifeng Ding, Fengfa Li +4
Mixture of Experts (MoE) architectures have become a key approach for scaling large language models, with growing interest in extending them to multimodal tasks. Existing methods t…