787 citations · 1.6k across the 22 of their papers we have counts for
Showing 2022Show all
2 papers · 1 filter
cs.CL2022
Parameter-Efficient Tuning Makes a Good Classification Head
Zhuoyi Yang, Ming Ding, Yanhui Guo +2
In recent years, pretrained models revolutionized the paradigm of natural language understanding (NLU), where we append a randomly initialized classification head after the pretrai…
cs.CV2022★ 116 cited
CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformers
Wenyi Hong, Ming Ding, Wendi Zheng +2
Large-scale pretrained transformers have created milestones in text (GPT-3) and text-to-image (DALL-E and CogView) generation. Its application to video generation is still facing m…