Towards Understanding Bugs in Distributed Training and Inference Frameworks for Large Language Models

Xiao Yu, Haoxuan Chen, Feifei Niu +3

With the rapid development of large language models (LLMs), distributed training and inference frameworks like DeepSpeed have become essential for scaling model training and infere…