Comparing the Pre-trained Models of Source Code by Re-pre-training under a Unified Setup

Changan Niu, Chuanyi Li, Vincent Ng +1

Recent years have seen the successful application of large pre-trained models of source code (CodePTMs) to code representation learning, which have taken the field of software engi…