POP: Online Structural Pruning Enables Efficient Inference of Large Foundation Models

Yi Chen, Wonjin Shin, Shuhong Liu +6

Large foundation models (LFMs) achieve strong performance through scaling, yet current structural pruning methods derive fixed pruning decisions during inference, overlooking spars…