activity
20212024
most citedMengzi: Towards Lightweight yet Ingenious Pre-trained Models for Chinese

30 citations · 60 across the 6 of their papers we have counts for

collaborators

6 papers

cs.CL2024

Bi-DCSpell: A Bi-directional Detector-Corrector Interactive Framework for Chinese Spelling Check

Haiming Wu, Hanqing Zhang, Richeng Xuan +1

Chinese Spelling Check (CSC) aims to detect and correct potentially misspelled characters in Chinese sentences. Naturally, it involves the detection and correction subtasks, which…

cs.CL2024

LLM-Oriented Retrieval Tuner

Si Sun, Hanqing Zhang, Zhiyuan Liu +2

Dense Retrieval (DR) is now considered as a promising tool to enhance the memorization capacity of Large Language Models (LLM) such as GPT3 and GPT-4 by incorporating external memo…

cs.CL2023

Controllable Text Generation with Residual Memory Transformer

Hanqing Zhang, Sun Si, Haiming Wu +1

Large-scale Causal Language Models (CLMs), e.g., GPT3 and ChatGPT, have brought great success in text generation. However, it is still an open challenge to control the generation p…

cs.CL2022★ 2 cited

DisCup: Discriminator Cooperative Unlikelihood Prompt-tuning for Controllable Text Generation

Hanqing Zhang, Dawei Song

Prompt learning with immensely large Casual Language Models (CLMs) has been shown promising for attribute-controllable text generation (CTG). However, vanilla prompt tuning tends t…

cs.CL2022★ 28 cited

A Survey of Controllable Text Generation using Transformer-based Pre-trained Language Models

Hanqing Zhang, Haolin Song, Shaoyu Li +2

Controllable Text Generation (CTG) is emerging area in the field of natural language generation (NLG). It is regarded as crucial for the development of advanced text generation tec…

cs.CL2021★ 30 cited

Mengzi: Towards Lightweight yet Ingenious Pre-trained Models for Chinese

Zhuosheng Zhang, Hanqing Zhang, Keming Chen +4

Although pre-trained models (PLMs) have achieved remarkable improvements in a wide range of NLP tasks, they are expensive in terms of time and resources. This calls for the study o…