A Benchmark Construction and Evaluation Framework for Specialist Domains: Case Study on Defense-related Documents

Bao Gia Doan, Aditya Joshi, Pantelis Elinas +4

RAG-based question-answering (QA) in specialist domains faces a cold-start problem: lack of evaluative benchmarks and absence of labeled data for post-training. We present DoRA (Do…