Retrospective Distillation Attribution via Normalized Response Similarity

Minwoo Jang, Jaechang Kim, Minhyeon Oh +2

Model distillation transfers capabilities through supervised fine-tuning (SFT) on teacher responses, often collected from commercial APIs, raising questions of model provenance. Ex…