Form Over Content In Gradient-Based Data Attribution Methods

Sunwoo Kim, Seokwon Jung, Sohyung Kim +2

Data attribution methods using gradient similarity are widely used to analyze and select training data for large language models, but what gradient similarity actually measures is…