112 citations · 442 across the 22 of their papers we have counts for
Showing cs.LGShow all
3 papers · 1 filter
cs.LG2022★ 20 cited
Meta Knowledge Distillation
Jihao Liu, Boxiao Liu, Hongsheng Li +1
Recent studies pointed out that knowledge distillation (KD) suffers from two degradation problems, the teacher-student gap and the incompatibility with strong data augmentations, m…
cs.LG2021★ 5 cited
FNAS: Uncertainty-Aware Fast Neural Architecture Search
Jihao Liu, Ming Zhang, Yangting Sun +4
Reinforcement learning (RL)-based neural architecture search (NAS) generally guarantees better convergence yet suffers from the requirement of huge computational resources compared…
cs.LG2019★ 36 cited
Knowledge Distillation via Route Constrained Optimization
Xiao Jin, Baoyun Peng, Yichao Wu +5
Distillation-based learning boosts the performance of the miniaturized neural network based on the hypothesis that the representation of a teacher model can be used as structured a…