Unifying Data, Memory, and Compute Efficiency in LLM training: A Survey

Vanessa Schmidt, Huy Hoang Nguyen, Cédric Jung +2

Resource constraints increasingly determine what can be trained, fine-tuned, and deployed in large language models (LLMs), yet efficiency is often studied through isolated techniqu…