Data Density Scaling Laws for Image Self-Distillation

Alvard Barseghyan, Ani Vanyan, Hakob Tamazyan +1

Current scaling law formulations suggest that increasing the number of unique samples in a dataset improves model performance, while repeated exposure to the same samples provides…