Pre-training Text Representations as Meta Learning

Shangwen Lv, Yuechen Wang, Daya Guo +10

Pre-training text representations has recently been shown to significantly improve the state-of-the-art in many natural language processing tasks. The central goal of pre-training…