IRB: Automated Generation of Robust Factuality Benchmarks

Lam Thanh Do, Bhagyashree Taleka, Hozaifa Ammar Bhutta +3

Static benchmarks for RAG systems often suffer from rapid saturation and require significant manual effort to maintain robustness. To address this, we present IRB, a framework for…