Distilling from Similar Tasks for Transfer Learning on a Budget

Kenneth Borup, Cheng Perng Phoo, Bharath Hariharan

We address the challenge of getting efficient yet accurate recognition systems with limited labels. While recognition models improve with model size and amount of data, many specia…