most citedLIMA: Less Is More for Alignment

128 citations · 159 across the 6 of their papers we have counts for

collaborators

6 papers

cs.CL2023

BLESS: Benchmarking Large Language Models on Sentence Simplification

Tannon Kew, Alison Chi, Laura Vásquez-Rodríguez +4

We present BLESS, a comprehensive performance benchmark of the most recent state-of-the-art large language models (LLMs) on the task of text simplification (TS). We examine how wel…

cs.CL2023★ 4 cited

Shepherd: A Critic for Language Model Generation

Tianlu Wang, Ping Yu, Xiaoqing Ellen Tan +7

As large language models improve, there is increasing interest in techniques that leverage these models' capabilities to refine their own outputs. In this work, we introduce Shephe…

cs.CL2023★ 13 cited

Self-Alignment with Instruction Backtranslation

Xian Li, Ping Yu, Chunting Zhou +5

We present a scalable method to build a high quality instruction following language model by automatically labelling human-written text with corresponding instructions. Our approac…

cs.CL2023★ 128 cited

LIMA: Less Is More for Alignment

Chunting Zhou, Pengfei Liu, Puxin Xu +12

Large language models are trained in two stages: (1) unsupervised pretraining from raw text, to learn general-purpose representations, and (2) large scale instruction tuning and re…

cs.CL2023★ 5 cited

OPT-R: Exploring the Role of Explanations in Finetuning and Prompting for Reasoning Skills of Large Language Models

Badr AlKhamissi, Siddharth Verma, Ping Yu +3

In this paper, we conduct a thorough investigation into the reasoning capabilities of Large Language Models (LLMs), focusing specifically on the Open Pretrained Transformers (OPT)…

cs.CL2022★ 9 cited

ALERT: Adapting Language Models to Reasoning Tasks

Ping Yu, Tianlu Wang, Olga Golovneva +6

Current large language models can perform reasonably well on complex tasks that require step-by-step reasoning with few-shot learning. Are these models applying reasoning skills th…