2 citations · 4 across the 7 of their papers we have counts for
Showing 2021Show all
3 papers · 1 filter
cs.CL2021
Marginal Utility Diminishes: Exploring the Minimum Knowledge for BERT Knowledge Distillation
Yuanxin Liu, Fandong Meng, Zheng Lin +2
Recently, knowledge distillation (KD) has shown great success in BERT compression. Instead of only learning from the teacher's soft label as in conventional KD, researchers find th…
cs.CV2021★ 2 cited
Check It Again: Progressive Visual Question Answering via Visual Entailment
Qingyi Si, Zheng Lin, Mingyu Zheng +2
While sophisticated Visual Question Answering models have achieved remarkable success, they tend to answer questions only according to superficial correlations between question and…
cs.CL2021
ROSITA: Refined BERT cOmpreSsion with InTegrAted techniques
Yuanxin Liu, Zheng Lin, Fengcheng Yuan
Pre-trained language models of the BERT family have defined the state-of-the-arts in a wide range of NLP tasks. However, the performance of BERT-based models is mainly driven by th…