1 citations · 1 across the 2 of their papers we have counts for
1 paper · 1 filter
Chengyu Dong, Liyuan Liu, Hao Cheng +3
ELECTRA pre-trains language models by detecting tokens in a sequence that have been replaced by an auxiliary model. Although ELECTRA offers a significant boost in efficiency, its p…