Sparsity-Accelerated Training for Large Language Models

Da Ma, Lu Chen, Pengyu Wang +6

Large language models (LLMs) have demonstrated proficiency across various natural language processing (NLP) tasks but often require additional training, such as continual pre-train…