Showing 2025Show all
2 papers · 1 filter
cs.LG2025
Thanos: A Block-wise Pruning Algorithm for Efficient Large Language Model Compression
Ivan Ilin, Peter Richtarik
This paper presents Thanos, a novel weight-pruning algorithm designed to reduce the memory footprint and enhance the computational efficiency of large language models (LLMs) by rem…
cs.LG2025
Hessian of Perplexity for Large Language Models by PyTorch autograd (Open Source)
Ivan Ilin
Computing the full Hessian matrix -- the matrix of second-order derivatives for an entire Large Language Model (LLM) is infeasible due to its sheer size. In this technical report,…