14 citations · 31 across the 28 of their papers we have counts for
Showing 2021Show all
2 papers · 1 filter
cs.LG2021★ 14 cited
M6-T: Exploring Sparse Expert Models and Beyond
An Yang, Junyang Lin, Rui Men +12
Mixture-of-Experts (MoE) models can achieve promising results with outrageous large amount of parameters but constant computation cost, and thus it has become a trend in model scal…
cs.CV2021★ 4 cited
Understanding Chinese Video and Language via Contrastive Multimodal Pre-Training
Chenyi Lei, Shixian Luo, Yong Liu +6
The pre-trained neural models have recently achieved impressive performances in understanding multimodal content. However, it is still very challenging to pre-train neural models f…