Neighborhood Contrastive Learning for Scientific Document Representations with Citation Embeddings

Malte Ostendorff, Nils Rethmeier, Isabelle Augenstein +2

Learning scientific document representations can be substantially improved through contrastive learning objectives, where the challenge lies in creating positive and negative train…