Pre-training Multi-task Contrastive Learning Models for Scientific Literature Understanding

Yu Zhang, Hao Cheng, Zhihong Shen +3

Scientific literature understanding tasks have gained significant attention due to their potential to accelerate scientific discovery. Pre-trained language models (LMs) have shown…