Encoding Multi-Domain Scientific Papers by Ensembling Multiple CLS Tokens

Ronald Seoh, Haw-Shiuan Chang, Andrew McCallum

Many useful tasks on scientific documents, such as topic classification and citation prediction, involve corpora that span multiple scientific domains. Typically, such tasks are ac…