No Memorization, No Detection: Output Distribution-Based Contamination Detection in Small Language Models

Omer Sela

CDD, or Contamination Detection via output Distribution, identifies data contamination by measuring the peakedness of a model's sampled outputs. We study the conditions under which…