19 citations · 63 across the 15 of their papers we have counts for
4 papers · 1 filter
Less or More From Teacher: Exploiting Trilateral Geometry For Knowledge Distillation
Chengming Hu, Haolun Wu, Xuan Li +5
Knowledge distillation aims to train a compact student network using soft supervision from a larger teacher network and hard supervision from ground truths. However, determining an…
Teacher-Student Architecture for Knowledge Distillation: A Survey
Chengming Hu, Xuan Li, Dan Liu +4
Although Deep neural networks (DNNs) have shown a strong capacity to solve large-scale problems in many areas, such DNNs are hard to be deployed in real-world systems due to their…
Teacher-Student Architecture for Knowledge Learning: A Survey
Chengming Hu, Xuan Li, Dan Liu +3
Although Deep Neural Networks (DNNs) have shown a strong capacity to solve large-scale problems in many areas, such DNNs with voluminous parameters are hard to be deployed in a rea…
Encoder-Decoder Architecture for Supervised Dynamic Graph Learning: A Survey
Yuecai Zhu, Fuyuan Lyu, Chengming Hu +2
In recent years, the prevalent online services generate a sheer volume of user activity data. Service providers collect these data in order to perform client behavior analysis, and…