6 citations · 13 across the 3 of their papers we have counts for
3 papers
cs.CR2022★ 3 cited
SeqNet: An Efficient Neural Network for Automatic Malware Detection
Jiawei Xu, Wenxuan Fu, Haoyu Bu +2
Malware continues to evolve rapidly, and more than 450,000 new samples are captured every day, which makes manual malware analysis impractical. However, existing deep learning dete…
cs.CL2021★ 6 cited
bert2BERT: Towards Reusable Pretrained Language Models
Cheng Chen, Yichun Yin, Lifeng Shang +7
In recent years, researchers tend to pre-train ever-larger language models to explore the upper limit of deep models. However, large language model pre-training costs intensive com…
cs.CL2021★ 4 cited
Extract then Distill: Efficient and Effective Task-Agnostic BERT Distillation
Cheng Chen, Yichun Yin, Lifeng Shang +4
Task-agnostic knowledge distillation, a teacher-student framework, has been proved effective for BERT compression. Although achieving promising results on NLP tasks, it requires en…