How not to Stitch Representations to Measure Similarity: Task Loss Matching versus Direct Matching

András Balogh, Márk Jelasity

Measuring the similarity of the internal representations of deep neural networks is an important and challenging problem. Model stitching has been proposed as a possible approach,…