2 citations · 8 across the 6 of their papers we have counts for
Showing 2020Show all
2 papers · 1 filter
cs.CV2020★ 1 cited
Multi-level Knowledge Distillation via Knowledge Alignment and Correlation
Fei Ding, Yin Yang, Hongxin Hu +2
Knowledge distillation (KD) has become an important technique for model compression and knowledge transfer. In this work, we first perform a comprehensive analysis of the knowledge…
cs.LG2020★ 2 cited
Second-order Neural Network Training Using Complex-step Directional Derivative
Siyuan Shen, Tianjia Shao, Kun Zhou +3
While the superior performance of second-order optimization methods such as Newton's method is well known, they are hardly used in practice for deep learning because neither assemb…