activity
20212023
most citedCogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformers

116 citations · 216 across the 6 of their papers we have counts for

collaborators

6 papers

cs.CV2023

MAE-GEBD:Winning the CVPR'2023 LOVEU-GEBD Challenge

Yuanxi Sun, Rui He, Youzeng Li +4

The Generic Event Boundary Detection (GEBD) task aims to build a model for segmenting videos into segments by detecting general event boundaries applicable to various classes. In t…

cs.CL2022

Parameter-Efficient Tuning Makes a Good Classification Head

Zhuoyi Yang, Ming Ding, Yanhui Guo +2

In recent years, pretrained models revolutionized the paradigm of natural language understanding (NLU), where we append a randomly initialized classification head after the pretrai…

cs.LG2022★ 50 cited

Video PreTraining (VPT): Learning to Act by Watching Unlabeled Online Videos

Bowen Baker, Ilge Akkaya, Peter Zhokhov +6

Pretraining on noisy, internet-scale datasets has been heavily studied as a technique for training models with broad, general capabilities for text, images, and other modalities. H…

cs.CV2022★ 116 cited

CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformers

Wenyi Hong, Ming Ding, Wendi Zheng +2

Large-scale pretrained transformers have created milestones in text (GPT-3) and text-to-image (DALL-E and CogView) generation. Its application to video generation is still facing m…

cs.CL2022★ 21 cited

EVA2.0: Investigating Open-Domain Chinese Dialogue Systems with Large-Scale Pre-Training

Yuxian Gu, Jiaxin Wen, Hao Sun +8

Large-scale pre-training has shown remarkable performance in building open-domain dialogue systems. However, previous works mainly focus on showing and evaluating the conversationa…

cs.CL2021★ 29 cited

EVA: An Open-Domain Chinese Dialogue System with Large-Scale Generative Pre-Training

Hao Zhou, Pei Ke, Zheng Zhang +11

Although pre-trained language models have remarkably enhanced the generation ability of dialogue systems, open-domain Chinese dialogue systems are still limited by the dialogue dat…