Revealing Secrets From Pre-trained Models

Mujahid Al Rafi, Yuan Feng, Hyeran Jeon

With the growing burden of training deep learning models with large data sets, transfer-learning has been widely adopted in many emerging deep learning algorithms. Transformer mode…