Cross-seed explainability using Procrustes-conditioned Joint End-to-end Top-K Sparse Autoencoders

Bendegúz Váradi, Zoltán Kmetty

We present a Procrustes-conditioned Joint End-to-end Top-K Sparse Autoencoder (SAE) for extracting cross-seed universal features from independently trained BERT models. Cross-seed…