Pre-training Language Model as a Multi-perspective Course Learner

Beiduo Chen, Shaohan Huang, Zihan Zhang +6

ELECTRA, the generator-discriminator pre-training framework, has achieved impressive semantic construction capability among various downstream tasks. Despite the convincing perform…