5 citations · 5 across the 3 of their papers we have counts for
3 papers
cs.CV2023
Distilling from Similar Tasks for Transfer Learning on a Budget
Kenneth Borup, Cheng Perng Phoo, Bharath Hariharan
We address the challenge of getting efficient yet accurate recognition systems with limited labels. While recognition models improve with model size and amount of data, many specia…
stat.ML2023
Self-Distillation for Gaussian Process Regression and Classification
Kenneth Borup, Lars Nørvang Andersen
We propose two approaches to extend the notion of knowledge distillation to Gaussian Process Regression (GPR) and Gaussian Process Classification (GPC); data-centric and distributi…
cs.LG2021★ 5 cited
Even your Teacher Needs Guidance: Ground-Truth Targets Dampen Regularization Imposed by Self-Distillation
Kenneth Borup, Lars N. Andersen
Knowledge distillation is classically a procedure where a neural network is trained on the output of another network along with the original targets in order to transfer knowledge…