Diversity Enhances an LLM's Performance in RAG and Long-context Task

Zhichao Wang, Bin Bi, Yanqi Luo +2

The rapid advancements in large language models (LLMs) have highlighted the challenge of context window limitations, primarily due to the quadratic time complexity of the self-atte…