49 citations · 62 across the 6 of their papers we have counts for
Showing cs.LGShow all
2 papers · 1 filter
cs.LG2025
HEAPr: Hessian-based Efficient Atomic Expert Pruning in Output Space
Ke Li, Zheng Yang, Zhongbin Zhou +3
Mixture-of-Experts (MoE) architectures in large language models (LLMs) deliver exceptional performance and reduced inference costs compared to dense LLMs. However, their large para…
cs.LG2020★ 13 cited
Entropy Minimization vs. Diversity Maximization for Domain Adaptation
Xiaofu Wu, Suofei hang, Quan Zhou +3
Entropy minimization has been widely used in unsupervised domain adaptation (UDA). However, existing works reveal that entropy minimization only may result into collapsed trivial s…