16 citations · 26 across the 7 of their papers we have counts for
Showing 2022Show all
2 papers · 1 filter
cs.LG2022★ 7 cited
Quantifying the Knowledge in a DNN to Explain Knowledge Distillation for Classification
Quanshi Zhang, Xu Cheng, Yilan Chen +1
Compared to traditional learning from scratch, knowledge distillation sometimes makes the DNN achieve superior performance. This paper provides a new perspective to explain the suc…
cs.LG2022★ 1 cited
Demystify Optimization and Generalization of Over-parameterized PAC-Bayesian Learning
Wei Huang, Chunrui Liu, Yilan Chen +2
PAC-Bayesian is an analysis framework where the training error can be expressed as the weighted average of the hypotheses in the posterior distribution whilst incorporating the pri…