activity
20202022
most citedCPT: A Pre-Trained Unbalanced Transformer for Both Chinese Language Understanding and Generation

110 citations · 128 across the 5 of their papers we have counts for

collaborators

5 papers

cs.CL2022

A Simple Hash-Based Early Exiting Approach For Language Understanding and Generation

Tianxiang Sun, Xiangyang Liu, Wei Zhu +7

Early exiting allows instances to exit at different layers according to the estimation of difficulty. Previous works usually adopt heuristic metrics such as the entropy of internal…

cs.CL2022★ 5 cited

TURNER: The Uncertainty-based Retrieval Framework for Chinese NER

Zhichao Geng, Hang Yan, Zhangyue Yin +2

Chinese NER is a difficult undertaking due to the ambiguity of Chinese characters and the absence of word boundaries. Previous work on Chinese NER focus on lexicon-based methods to…

cs.CL2021★ 12 cited

RetrievalSum: A Retrieval Enhanced Framework for Abstractive Summarization

Chenxin An, Ming Zhong, Zhichao Geng +2

Existing summarization systems mostly generate summaries purely relying on the content of the source document. However, even for humans, we usually need some references or exemplar…

cs.CL2021★ 110 cited

CPT: A Pre-Trained Unbalanced Transformer for Both Chinese Language Understanding and Generation

Yunfan Shao, Zhichao Geng, Yitao Liu +6

In this paper, we take the advantage of previous pre-trained models (PTMs) and propose a novel Chinese Pre-trained Unbalanced Transformer (CPT). Different from previous Chinese PTM…

cs.CL2020★ 1 cited

fastHan: A BERT-based Multi-Task Toolkit for Chinese NLP

Zhichao Geng, Hang Yan, Xipeng Qiu +1

We present fastHan, an open-source toolkit for four basic tasks in Chinese natural language processing: Chinese word segmentation (CWS), Part-of-Speech (POS) tagging, named entity…