Long Context vs. RAG for LLMs: An Evaluation and Revisits

Xinze Li, Yixin Cao, Yubo Ma +1

Extending context windows (i.e., Long Context, LC) and using retrievers to selectively access relevant information (i.e., Retrieval-Augmented Generation, RAG) are the two main stra…