works on
fisher information 1kronecker approximation 1large language model compression 1post-training pruning 1svd 1

From the 1 of 2 linked papers with an AI index.

collaborators
Showing cs.LGShow all

1 paper · 1 filter

cs.LG2026

Generalized Fisher-Weighted SVD: Scalable Kronecker-Factored Fisher Approximation for Compressing Large Language Models

Viktoriia Chekalina, Daniil Moskovskiy, Tatiana Matveeva +2

The paper introduces Generalized Fisher-Weighted SVD (GFWSVD), a post‑training compression method for large language models that uses a scalable Kronecker‑factored approximation of…