17 citations · 27 across the 3 of their papers we have counts for
3 papers
cs.CV2021
Multi-granularity for knowledge distillation
Baitan Shao, Ying Chen
Considering the fact that students have different abilities to understand the knowledge imparted by teachers, a multi-granularity distillation mechanism is proposed for transferrin…
cs.CL2021★ 10 cited
NT5?! Training T5 to Perform Numerical Reasoning
Peng-Jian Yang, Ying Ting Chen, Yuechan Chen +1
Numerical reasoning over text (NRoT) presents unique challenges that are not well addressed by existing pre-training objectives. We explore five sequential training schedules that…
cs.CL2021★ 17 cited
Refining Language Models with Compositional Explanations
Huihan Yao, Ying Chen, Qinyuan Ye +2
Pre-trained language models have been successful on text classification tasks, but are prone to learning spurious correlations from biased datasets, and are thus vulnerable when ma…