ATTUNE: Agentic Throughput Tuning for LLM Training

Leo Fan, Hongyang Wang, Wenbo Chen +10

Training a large language model can occupy thousands of GPUs for weeks, and its speed depends on its recipe: how the model is split across GPUs, how memory is traded for compute, a…