Showing cs.CLShow all
2 papers · 1 filter
cs.CL2026
What Gets Activated: Uncovering Domain and Driver Experts in MoE Language Models
Guimin Hu, Meng Li, Qiwei Peng +3
Most interpretability work focuses on layer- or neuron-level mechanisms in Transformers, leaving expert-level behavior in MoE LLMs underexplored. Motivated by functional specializa…
cs.CL2025
Partitioner Guided Modal Learning Framework
Guimin Hu, Yi Xin, Lijie Hu +2
Multimodal learning benefits from multiple modal information, and each learned modal representations can be divided into uni-modal that can be learned from uni-modal training and p…