Showing cs.CLShow all
2 papers · 1 filter
cs.CL2026
XPERT: Expert Knowledge Transfer for Effective Training of Language Models
Chang Liu, Boyu Shi, Xu Yang +1
Mixture-of-Experts (MoE) language models organize knowledge into explicitly routed expert modules, making expert-level representations traceable and analyzable. By analyzing expert…
cs.CL2024
LIVE: Learnable In-Context Vector for Visual Question Answering
Yingzhe Peng, Chenduo Hao, Xu Yang +3
As language models continue to scale, Large Language Models (LLMs) have exhibited emerging capabilities in In-Context Learning (ICL), enabling them to solve language tasks by prefi…