18 citations · 37 across the 6 of their papers we have counts for
Showing cs.LGShow all
3 papers · 1 filter
cs.LG2023★ 2 cited
Less or More From Teacher: Exploiting Trilateral Geometry For Knowledge Distillation
Chengming Hu, Haolun Wu, Xuan Li +5
Knowledge distillation aims to train a compact student network using soft supervision from a larger teacher network and hard supervision from ground truths. However, determining an…
cs.LG2023★ 13 cited
Teacher-Student Architecture for Knowledge Distillation: A Survey
Chengming Hu, Xuan Li, Dan Liu +4
Although Deep neural networks (DNNs) have shown a strong capacity to solve large-scale problems in many areas, such DNNs are hard to be deployed in real-world systems due to their…
cs.LG2022★ 18 cited
Teacher-Student Architecture for Knowledge Learning: A Survey
Chengming Hu, Xuan Li, Dan Liu +3
Although Deep Neural Networks (DNNs) have shown a strong capacity to solve large-scale problems in many areas, such DNNs with voluminous parameters are hard to be deployed in a rea…