Beyond Adjacent Layers: Graph-Guided Layer Fusion for Compressing Large Language Models

Muhammad Usama, Yeoreum Jung

Existing depth-compression methods for large language models (LLMs) score layers individually or group only adjacent or contiguous layers, implicitly assuming that functional redun…