17 citations · 27 across the 6 of their papers we have counts for
3 papers · 1 filter
A Framework for Generating Valid Context-Specific Benchmarks through Expert Guidance
Kimberly Le Truong, Nari Johnson, Anna Kawakami +1
This paper presents an end-to-end approach for generating context-specific large language model (LLM) benchmark datasets by combining expert input with synthetic data generation. E…
Evaluating AI-Generated Images of Cultural Artifacts with Community-Informed Rubrics
Nari Johnson, Deepthi Sudharsan, Hamna +7
Measurement is essential to improving AI performance and mitigating harms for marginalized groups. As generative AI systems are rapidly deployed across geographies and contexts, AI…
Disclosure or Marketing? Analyzing the Efficacy of Vendor Self-reports for Vetting Public-sector AI
Blaine Kuehnert, Nari Johnson, Ravit Dotan +1
Documentation-based disclosure has become a central governance strategy for responsible AI, particularly in public-sector procurement. Tools such as model cards, datasheets, and AI…