1.2k citations · 1.4k across the 19 of their papers we have counts for
19 papers
IDOL: Indicator-oriented Logic Pre-training for Logical Reasoning
Zihang Xu, Ziqing Yang, Yiming Cui +1
In the field of machine reading comprehension (MRC), existing systems have surpassed the average performance of human beings in many tasks like SQuAD. However, there is still a lon…
MiniRBT: A Two-stage Distilled Small Chinese Pre-trained Model
Xin Yao, Ziqing Yang, Yiming Cui +1
In natural language processing, pre-trained language models have become essential infrastructures. However, these models often suffer from issues such as large size, long inference…
Efficient and Effective Text Encoding for Chinese LLaMA and Alpaca
Yiming Cui, Ziqing Yang, Xin Yao
Large Language Models (LLMs), such as ChatGPT and GPT-4, have dramatically transformed natural language processing research and shown promising strides towards Artificial General I…
From Visual Prompt Learning to Zero-Shot Transfer: Mapping Is All You Need
Ziqing Yang, Zeyang Sha, Michael Backes +1
Visual prompt learning, as a newly emerged technique, leverages the knowledge learned by a large-scale pre-trained model and adapts it to downstream tasks through the usage of prom…
Gradient-based Intra-attention Pruning on Pre-trained Language Models
Ziqing Yang, Yiming Cui, Xin Yao +1
Pre-trained language models achieve superior performance but are computationally expensive. Techniques such as pruning and knowledge distillation have been developed to reduce thei…
HIT at SemEval-2022 Task 2: Pre-trained Language Model for Idioms Detection
Zheng Chu, Ziqing Yang, Yiming Cui +2
The same multi-word expressions may have different meanings in different sentences. They can be mainly divided into two categories, which are literal meaning and idiomatic meaning.…
HFL at SemEval-2022 Task 8: A Linguistics-inspired Regression Model with Data Augmentation for Multilingual News Similarity
Zihang Xu, Ziqing Yang, Yiming Cui +1
This paper describes our system designed for SemEval-2022 Task 8: Multilingual News Article Similarity. We proposed a linguistics-inspired model trained with a few task-specific st…
TextPruner: A Model Pruning Toolkit for Pre-Trained Language Models
Ziqing Yang, Yiming Cui, Zhigang Chen
Pre-trained language models have been prevailed in natural language processing and become the backbones of many NLP tasks, but the demands for computational resources have limited…
PERT: Pre-training BERT with Permuted Language Model
Yiming Cui, Ziqing Yang, Ting Liu
Pre-trained Language Models (PLMs) have been widely used in various natural language processing (NLP) tasks, owing to their powerful text representations trained on large-scale cor…
Structure of test magnetic fields and charged particle motion around the Hayward spacetime
Ziou Yang, Yen-Kheng Lim
A configuration of a test magnetic field in Hayward spacetime is obtained by solving Maxwell's equation with the Hayward metric as the background. The magnetic field lines show a d…
Cross-Lingual Text Classification with Multilingual Distillation and Zero-Shot-Aware Training
Ziqing Yang, Yiming Cui, Zhigang Chen +1
Multilingual pre-trained language models (MPLMs) not only can handle tasks in different languages but also exhibit surprising zero-shot cross-lingual transferability. However, MPLM…
CINO: A Chinese Minority Pre-trained Language Model
Ziqing Yang, Zihang Xu, Yiming Cui +4
Multilingual pre-trained language models have shown impressive performance on cross-lingual tasks. It greatly facilitates the applications of natural language processing on low-res…
Benchmarking Robustness of Machine Reading Comprehension Models
Chenglei Si, Ziqing Yang, Yiming Cui +3
Machine Reading Comprehension (MRC) is an important testbed for evaluating models' natural language understanding (NLU) ability. There has been rapid progress in this area, with ne…
A Sentence Cloze Dataset for Chinese Machine Reading Comprehension
Yiming Cui, Ting Liu, Ziqing Yang +5
Owing to the continuous efforts by the Chinese NLP community, more and more Chinese machine reading comprehension datasets become available. To add diversity in this area, in this…
TextBrewer: An Open-Source Knowledge Distillation Toolkit for Natural Language Processing
Ziqing Yang, Yiming Cui, Zhipeng Chen +4
In this paper, we introduce TextBrewer, an open-source knowledge distillation toolkit designed for natural language processing. It works with different neural network models and su…
Improving Machine Reading Comprehension via Adversarial Training
Ziqing Yang, Yiming Cui, Wanxiang Che +3
Adversarial training (AT) as a regularization method has proved its effectiveness in various tasks, such as image classification and text classification. Though there are successfu…
Pre-Training with Whole Word Masking for Chinese BERT
Yiming Cui, Wanxiang Che, Ting Liu +2
Bidirectional Encoder Representations from Transformers (BERT) has shown marvelous improvements across various NLP tasks, and its consecutive variants have been proposed to further…
On the evaporation of solar dark matter: spin-independent effective operators
Zheng-Liang Liang, Yue-Liang Wu, Zi-Qing Yang +1
As a part of the effort to investigate the implications of dark matter (DM)-nucleon effective interactions on the solar DM detection, in this paper we focus on the evaporation of t…
Critical behaviors and universality classes of percolation phase transitions on two-dimensional square lattice
Yong Zhu, Ziqing Yang, Xin Zhang +1
We have investigated both site and bond percolation on two dimensional lattice under the random rule and the product rule respectively. With the random rule, sites or bonds are add…