Simplifying Knowledge Transfer in Pretrained Models

Siddharth Jain, Shyamgopal Karthik, Vineet Gandhi

Pretrained models are ubiquitous in the current deep learning landscape, offering strong results on a broad range of tasks. Recent works have shown that models differing in various…