Matrix-Driven Identification and Reconstruction of LLM Weight Homology

Ruichong Zhang, Daniel Goldstein

We propose Matrix-Driven Identification and Reconstruction (MDIR), a SOTA large language model homology method that accurately detects weight correspondences between models and pro…