4 papers · 1 filter
LongNovel: A Multi-Scale Benchmark for Hallucination Detection in Long-Context Novel Summarization
Ruizhi Zhang, Jinwei Chen, Xiangju Lu +4
Although context windows have expanded significantly in recent years, hallucinations in long-context summarization remain a challenge. Long novels are better suited than news or pa…
From Data to Insights: Exploring Program-of-Thoughts Prompting for Chart Summarization
Yutong Qu, Wei Zhang
Charts play a critical role in conveying numerical data insights through structured visual representations. However, semantic visual understanding and numerical reasoning requireme…
LIFBench: Evaluating the Instruction Following Performance and Stability of Large Language Models in Long-Context Scenarios
Xiaodong Wu, Minhao Wang, Yichen Liu +5
As Large Language Models (LLMs) evolve in natural language processing (NLP), their ability to stably follow instructions in long-context inputs has become critical for real-world a…
CNNSum: Exploring Long-Context Summarization with Large Language Models in Chinese Novels
Lingxiao Wei, He Yan, Xiangju Lu +3
Large language models (LLMs) have been well-researched in various long-context tasks. However, the scarcity of long-context summarization datasets hinders progress in this area. To…