307 citations · 624 across the 19 of their papers we have counts for
4 papers · 1 filter
Learning to Auto Weight: Entirely Data-driven and Highly Efficient Weighting Framework
Zhenmao Li, Yichao Wu, Ken Chen +4
Example weighting algorithm is an effective solution to the training bias problem, however, most previous typical methods are usually limited to human knowledge and require laborio…
Knowledge Distillation via Route Constrained Optimization
Xiao Jin, Baoyun Peng, Yichao Wu +5
Distillation-based learning boosts the performance of the miniaturized neural network based on the hypothesis that the representation of a teacher model can be used as structured a…
Correlation Congruence for Knowledge Distillation
Baoyun Peng, Xiao Jin, Jiaheng Liu +5
Most teacher-student frameworks based on knowledge distillation (KD) depend on a strong congruent constraint on instance level. However, they usually ignore the correlation between…
Dynamic Multi-path Neural Network
Yingcheng Su, Shunfeng Zhou, Yichao Wu +7
Although deeper and larger neural networks have achieved better performance, the complex network structure and increasing computational cost cannot meet the demands of many resourc…