1 citations · 1 across the 3 of their papers we have counts for
3 papers
cs.LG2023
Knowledge Distillation via Token-level Relationship Graph
Shuoxi Zhang, Hanpeng Liu, Kun He
Knowledge distillation is a powerful technique for transferring knowledge from a pre-trained teacher model to a student model. However, the true potential of knowledge transfer has…
cs.CV2022
Class-aware Information for Logit-based Knowledge Distillation
Shuoxi Zhang, Hanpeng Liu, John E. Hopcroft +1
Knowledge distillation aims to transfer knowledge to the student model by utilizing the predictions/features of the teacher model, and feature-based distillation has recently shown…
cs.LG2022★ 1 cited
Generating Pseudo-labels Adaptively for Few-shot Model-Agnostic Meta-Learning
Guodong Liu, Tongling Wang, Shuoxi Zhang +1
Model-Agnostic Meta-Learning (MAML) is a famous few-shot learning method that has inspired many follow-up efforts, such as ANIL and BOIL. However, as an inductive method, MAML is u…