Generate to Understand for Representation

Changshang Xue, Xiande Zhong, Xiaoqing Liu

In recent years, a significant number of high-quality pretrained models have emerged, greatly impacting Natural Language Understanding (NLU), Natural Language Generation (NLG), and…