activity
20162026
most citedStarCoder 2 and The Stack v2: The Next Generation

67 citations · 182 across the 41 of their papers we have counts for

collaborators
Showing 2023Show all

8 papers · 1 filter

cs.CL2023

AfriMTE and AfriCOMET: Enhancing COMET to Embrace Under-resourced African Languages

Jiayi Wang, David Ifeoluwa Adelani, Sweta Agrawal +55

Despite the recent progress on scaling multilingual machine translation (MT) to several under-resourced African languages, accurately measuring this progress remains challenging, s…

cs.CL2023

Using Natural Language Explanations to Improve Robustness of In-context Learning

Xuanli He, Yuxiang Wu, Oana-Maria Camburu +2

Recent studies demonstrated that large language models (LLMs) can excel in many tasks via in-context learning (ICL). However, recent works show that ICL-prompted models tend to pro…

cs.CL2023★ 29 cited

Use of LLMs for Illicit Purposes: Threats, Prevention Measures, and Vulnerabilities

Maximilian Mozes, Xuanli He, Bennett Kleinberg +1

Spurred by the recent rapid increase in the development and distribution of large language models (LLMs) across industry and academia, much recent work has drawn attention to safet…

cs.CL2023

Can Knowledge Graphs Simplify Text?

Anthony Colas, Haodi Ma, Xuanli He +2

Knowledge Graph (KG)-to-Text Generation has seen recent improvements in generating fluent and informative sentences which describe a given KG. As KGs are widespread across multiple…

cs.CL2023★ 1 cited

IMBERT: Making BERT Immune to Insertion-based Backdoor Attacks

Xuanli He, Jun Wang, Benjamin Rubinstein +1

Backdoor attacks are an insidious security threat against machine learning models. Adversaries can manipulate the predictions of compromised models by inserting triggers into the t…

cs.CL2023★ 4 cited

G3Detector: General GPT-Generated Text Detector

Haolan Zhan, Xuanli He, Qiongkai Xu +2

The burgeoning progress in the field of Large Language Models (LLMs) heralds significant benefits due to their unparalleled capacities. However, it is critical to acknowledge the p…

cs.CL2023★ 1 cited

Mitigating Backdoor Poisoning Attacks through the Lens of Spurious Correlation

Xuanli He, Qiongkai Xu, Jun Wang +2

Modern NLP models are often trained over large untrusted datasets, raising the potential for a malicious adversary to compromise model behaviour. For instance, backdoors can be imp…

cs.CL2023

Koala: An Index for Quantifying Overlaps with Pre-training Corpora

Thuy-Trang Vu, Xuanli He, Gholamreza Haffari +1

In very recent years more attention has been placed on probing the role of pre-training data in Large Language Models (LLMs) downstream behaviour. Despite the importance, there is…