On Positional Bias of Faithfulness for Long-form Summarization

David Wan, Jesse Vig, Mohit Bansal +1

Large Language Models (LLMs) often exhibit positional bias in long-context settings, under-attending to information in the middle of inputs. We investigate the presence of this bia…