13 citations · 51 across the 35 of their papers we have counts for
Showing 2021Show all
2 papers · 1 filter
cs.CL2021
Marginal Utility Diminishes: Exploring the Minimum Knowledge for BERT Knowledge Distillation
Yuanxin Liu, Fandong Meng, Zheng Lin +2
Recently, knowledge distillation (KD) has shown great success in BERT compression. Instead of only learning from the teacher's soft label as in conventional KD, researchers find th…
cs.CV2021★ 2 cited
Check It Again: Progressive Visual Question Answering via Visual Entailment
Qingyi Si, Zheng Lin, Mingyu Zheng +2
While sophisticated Visual Question Answering models have achieved remarkable success, they tend to answer questions only according to superficial correlations between question and…