Hierarchical Multitask Learning Approach for BERT

Çağla Aksoy, Alper Ahmetoğlu, Tunga Güngör

Recent works show that learning contextualized embeddings for words is beneficial for downstream tasks. BERT is one successful example of this approach. It learns embeddings by sol…