8 citations · 10 across the 6 of their papers we have counts for
10 papers · 1 filter
IDOL: Indicator-oriented Logic Pre-training for Logical Reasoning
Zihang Xu, Ziqing Yang, Yiming Cui +1
In the field of machine reading comprehension (MRC), existing systems have surpassed the average performance of human beings in many tasks like SQuAD. However, there is still a lon…
MiniRBT: A Two-stage Distilled Small Chinese Pre-trained Model
Xin Yao, Ziqing Yang, Yiming Cui +1
In natural language processing, pre-trained language models have become essential infrastructures. However, these models often suffer from issues such as large size, long inference…
Efficient and Effective Text Encoding for Chinese LLaMA and Alpaca
Yiming Cui, Ziqing Yang, Xin Yao
Large Language Models (LLMs), such as ChatGPT and GPT-4, have dramatically transformed natural language processing research and shown promising strides towards Artificial General I…
HIT at SemEval-2022 Task 2: Pre-trained Language Model for Idioms Detection
Zheng Chu, Ziqing Yang, Yiming Cui +2
The same multi-word expressions may have different meanings in different sentences. They can be mainly divided into two categories, which are literal meaning and idiomatic meaning.…
HFL at SemEval-2022 Task 8: A Linguistics-inspired Regression Model with Data Augmentation for Multilingual News Similarity
Zihang Xu, Ziqing Yang, Yiming Cui +1
This paper describes our system designed for SemEval-2022 Task 8: Multilingual News Article Similarity. We proposed a linguistics-inspired model trained with a few task-specific st…
TextPruner: A Model Pruning Toolkit for Pre-Trained Language Models
Ziqing Yang, Yiming Cui, Zhigang Chen
Pre-trained language models have been prevailed in natural language processing and become the backbones of many NLP tasks, but the demands for computational resources have limited…