43 citations · 124 across the 14 of their papers we have counts for
5 papers · 1 filter
Kimi K2: Open Agentic Intelligence
Kimi Team, Yifan Bai, Yiping Bao +195
We introduce Kimi K2, a Mixture-of-Experts (MoE) large language model with 32 billion activated parameters and 1 trillion total parameters. We propose the MuonClip optimizer, which…
Improving Multi-Modal Learning with Uni-Modal Teachers
Chenzhuang Du, Tingle Li, Yichen Liu +4
Learning multi-modal representations is an essential step towards real-world robotic applications, and various multi-modal fusion models have been developed for this purpose. Howev…
Intrinsically Motivated Self-supervised Learning in Reinforcement Learning
Yue Zhao, Chenzhuang Du, Hang Zhao +1
In vision-based reinforcement learning (RL) tasks, it is prevalent to assign auxiliary tasks with a surrogate self-supervised loss so as to obtain more semantic representations and…
What Makes Multi-modal Learning Better than Single (Provably)
Yu Huang, Chenzhuang Du, Zihui Xue +3
The world provides us with data of multiple modalities. Intuitively, models fusing data from different modalities outperform their uni-modal counterparts, since more information is…
Secure Data Sharing With Flow Model
Chenwei Wu, Chenzhuang Du, Yang Yuan
In the classical multi-party computation setting, multiple parties jointly compute a function without revealing their own input data. We consider a variant of this problem, where t…