A Framework for Generating Valid Context-Specific Benchmarks through Expert Guidance

Kimberly Le Truong, Nari Johnson, Anna Kawakami +1

This paper presents an end-to-end approach for generating context-specific large language model (LLM) benchmark datasets by combining expert input with synthetic data generation. E…