67 citations · 182 across the 41 of their papers we have counts for
7 papers · 1 filter
Protecting Intellectual Property of Language Generation APIs with Lexical Watermark
Xuanli He, Qiongkai Xu, Lingjuan Lyu +2
Nowadays, due to the breakthrough in natural language generation (NLG), including machine translation, document summarization, image captioning, etc NLG models have been encapsulat…
Magic Pyramid: Accelerating Inference with Early Exiting and Token Pruning
Xuanli He, Iman Keivanloo, Yi Xu +4
Pre-training and then fine-tuning large language models is commonly used to achieve state-of-the-art performance in natural language processing (NLP) tasks. However, most pre-train…
Generalised Unsupervised Domain Adaptation of Neural Machine Translation with Cross-Lingual Data Selection
Thuy-Trang Vu, Xuanli He, Dinh Phung +1
This paper considers the unsupervised domain adaptation problem for neural machine translation (NMT), where we assume the access to only monolingual text in either the source or ta…
Student Surpasses Teacher: Imitation Attack for Black-Box NLP APIs
Qiongkai Xu, Xuanli He, Lingjuan Lyu +2
Machine-learning-as-a-service (MLaaS) has attracted millions of users to their splendid large-scale models. Although published as black-box APIs, the valuable models behind these s…
Generate, Annotate, and Learn: NLP with Synthetic Text
Xuanli He, Islam Nassar, Jamie Kiros +2
This paper studies the use of language models as a source of synthetic unlabeled text for NLP. We formulate a general framework called ``generate, annotate, and learn (GAL)'' to ta…
Killing One Bird with Two Stones: Model Extraction and Attribute Inference Attacks against BERT-based APIs
Chen Chen, Xuanli He, Lingjuan Lyu +1
The collection and availability of big data, combined with advances in pre-trained models (e.g., BERT, XLNET, etc), have revolutionized the predictive performance of modern natural…
Model Extraction and Adversarial Transferability, Your BERT is Vulnerable!
Xuanli He, Lingjuan Lyu, Qiongkai Xu +1
Natural language processing (NLP) tasks, ranging from text classification to text generation, have been revolutionised by the pre-trained language models, such as BERT. This allows…