6 citations · 14 across the 7 of their papers we have counts for
Showing 2021Show all
3 papers · 1 filter
cs.CL2021★ 6 cited
bert2BERT: Towards Reusable Pretrained Language Models
Cheng Chen, Yichun Yin, Lifeng Shang +7
In recent years, researchers tend to pre-train ever-larger language models to explore the upper limit of deep models. However, large language model pre-training costs intensive com…
cs.CL2021★ 4 cited
Extract then Distill: Efficient and Effective Task-Agnostic BERT Distillation
Cheng Chen, Yichun Yin, Lifeng Shang +4
Task-agnostic knowledge distillation, a teacher-student framework, has been proved effective for BERT compression. Although achieving promising results on NLP tasks, it requires en…
cs.CV2021★ 1 cited
Deepfake Forensics via An Adversarial Game
Zhi Wang, Yiwen Guo, Wangmeng Zuo
With the progress in AI-based facial forgery (i.e., deepfake), people are increasingly concerned about its abuse. Albeit effort has been made for training classification (also know…