Much Easier Said Than Done: Falsifying the Causal Relevance of Linear Decoding Methods

Lucas Hayne, Abhijit Suresh, Hunar Jain +2

Linear classifier probes are frequently utilized to better understand how neural networks function. Researchers have approached the problem of determining unit importance in neural…