The Deleuzian Representation Hypothesis

Clément Cornet, Romaric Besançon, Hervé Le Borgne

We propose an alternative to sparse autoencoders (SAEs) as a simple and effective unsupervised method for extracting interpretable concepts from neural networks. The core idea is t…