most citedExtending LLMs' Context Window with 100 Samples

1 citations · 1 across the 4 of their papers we have counts for

collaborators

7 papers

cs.AI2024

FRoG: Evaluating Fuzzy Reasoning of Generalized Quantifiers in Large Language Models

Yiyuan Li, Shichao Sun, Pengfei Liu

Fuzzy reasoning is vital due to the frequent use of imprecise information in daily contexts. However, the ability of current large language models (LLMs) to handle such reasoning r…

cs.CL2024

Prompt Chaining or Stepwise Prompt? Refinement in Text Summarization

Shichao Sun, Ruifeng Yuan, Ziqiang Cao +2

Large language models (LLMs) have demonstrated the capacity to improve summary quality by mirroring a human-like iterative process of critique and refinement starting from the init…

cs.CL2024

Dissecting Human and LLM Preferences

Junlong Li, Fan Zhou, Shichao Sun +3

As a relative quality comparison of model responses, human and Large Language Model (LLM) preferences serve as common alignment goals in model fine-tuning and criteria in evaluatio…

cs.CL2024

Reformatted Alignment

Run-Ze Fan, Xuefeng Li, Haoyang Zou +5

The quality of finetuning data is crucial for aligning large language models (LLMs) with human values. Current methods to improve data quality are either labor-intensive or prone t…

cs.CL20241 cited

Extending LLMs' Context Window with 100 Samples

Yikai Zhang, Junlong Li, Pengfei Liu

Large Language Models (LLMs) are known to have limited extrapolation ability beyond their pre-trained context window, constraining their application in downstream tasks with length…

cs.CL2024

The Critique of Critique

Shichao Sun, Junlong Li, Weizhe Yuan +3

Critique, as a natural language description for assessing the quality of model-generated content, has played a vital role in the training, evaluation, and refinement of LLMs. Howev…