Decoding Alignment without Encoding Alignment: A critique of similarity analysis in neuroscience

Johannes Bertram, Luciano Dyballa, T. Anderson Keller +2

RSA and CKA are standard metrics for comparing neural representations across brain regions, organisms, and deep learning models. We demonstrate a fundamental weakness: these decodi…