PDTrim: Targeted Pruning for Prefill-Decode Disaggregation in Inference

Hao Zhang, Mengsi Lyu, Zhuo Chen +3

Large Language Models (LLMs) demonstrate exceptional capabilities across various tasks, but their deployment is constrained by high computational and memory costs. Model pruning pr…