DReSS: Data-driven Regularized Structured Streamlining for Large Language Models

Mingkuan Feng, Jinyang Wu, Shuai Zhang +5

Large language models (LLMs) have achieved significant progress across various domains, but their increasing scale results in high computational and memory costs. Recent studies ha…