Accelerating Compound LLM Training Workloads with Maestro

Xiulong Yuan, Hongqing Chen, Jiaxuan Peng +16

Compound LLM training workloads-such as knowledge distillation and multimodal LLM (MLLM) training-are gaining prominence. These typically comprise heterogeneous components differin…