IrekoGPT: Turning Structured Pruning into Post-Hoc Slimmable LLMs

Pietro Moriello, Pietro Buzzega, Angelo Porrello +1

We introduce IrekoGPT, a post-hoc method for converting pretrained LLMs into slimmable models whose width can be adjusted at inference time. Building on SliceGPT, we retain its pro…