Does Optimal Source Task Performance Imply Optimal Pre-training for a Target Task?

Steven Gutstein, Brent Lance, Sanjay Shakkottai

Fine-tuning of pre-trained deep nets is commonly used to improve accuracies and training times for neural nets. It is generally assumed that pre-training a net for optimal source t…