2 papers
cs.CV2023
Distilling from Similar Tasks for Transfer Learning on a Budget
Kenneth Borup, Cheng Perng Phoo, Bharath Hariharan
We address the challenge of getting efficient yet accurate recognition systems with limited labels. While recognition models improve with model size and amount of data, many specia…
stat.ML2023
Self-Distillation for Gaussian Process Regression and Classification
Kenneth Borup, Lars Nørvang Andersen
We propose two approaches to extend the notion of knowledge distillation to Gaussian Process Regression (GPR) and Gaussian Process Classification (GPC); data-centric and distributi…