4 papers
FRoG: Evaluating Fuzzy Reasoning of Generalized Quantifiers in Large Language Models
Yiyuan Li, Shichao Sun, Pengfei Liu
Fuzzy reasoning is vital due to the frequent use of imprecise information in daily contexts. However, the ability of current large language models (LLMs) to handle such reasoning r…
Prompt Chaining or Stepwise Prompt? Refinement in Text Summarization
Shichao Sun, Ruifeng Yuan, Ziqiang Cao +2
Large language models (LLMs) have demonstrated the capacity to improve summary quality by mirroring a human-like iterative process of critique and refinement starting from the init…
The Critique of Critique
Shichao Sun, Junlong Li, Weizhe Yuan +3
Critique, as a natural language description for assessing the quality of model-generated content, has played a vital role in the training, evaluation, and refinement of LLMs. Howev…
Reformatted Alignment
Run-Ze Fan, Xuefeng Li, Haoyang Zou +5
The quality of finetuning data is crucial for aligning large language models (LLMs) with human values. Current methods to improve data quality are either labor-intensive or prone t…