Benchmark Contamination: A Taxonomy Organized by Defeated Mitigation

Johanna Angulo, Víctor Yeste, Hector Espinos-Morato

A benchmark score is a joint property of the model, the evaluation harness, the elicitation budget, the sampled population, and contamination status. Leaderboards publish the model…