40 citations · 100 across the 13 of their papers we have counts for
Showing cs.LGShow all
2 papers · 1 filter
cs.LG2025★ 14 cited
Kimi K2: Open Agentic Intelligence
Kimi Team, Yifan Bai, Yiping Bao +195
We introduce Kimi K2, a Mixture-of-Experts (MoE) large language model with 32 billion activated parameters and 1 trillion total parameters. We propose the MuonClip optimizer, which…
cs.LG2020★ 40 cited
Channel Distillation: Channel-Wise Attention for Knowledge Distillation
Zaida Zhou, Chaoran Zhuge, Xinwei Guan +1
Knowledge distillation is to transfer the knowledge from the data learned by the teacher network to the student network, so that the student has the advantage of less parameters an…