Beyond Benchmark Scores: How Synthetic and Authentic Query Distributions Diverge in RAG Evaluation

Filip J. Kucia, Barbara M. Gawlik

RAG systems are routinely evaluated using synthetic question sets generated from the target document corpus. While this practice provides a useful check on overall retrieval capabi…