fisher information 1kronecker approximation 1large language model compression 1post-training pruning 1svd 1
From the 1 of 2 linked papers with an AI index.
2 papers
cs.LG2026
Generalized Fisher-Weighted SVD: Scalable Kronecker-Factored Fisher Approximation for Compressing Large Language Models
Viktoriia Chekalina, Daniil Moskovskiy, Tatiana Matveeva +2
The paper introduces Generalized Fisher-Weighted SVD (GFWSVD), a post‑training compression method for large language models that uses a scalable Kronecker‑factored approximation of…
cs.CL2026
CoRoVA: Compressed Representations for Vector-Augmented Code Completion
Daria Cherniuk, Nikita Sukhorukov, Danil Gusak +4
Retrieval-augmented generation has emerged as one of the most effective approaches for code completion enhancement, especially when repository-level context is important. However,…