FusionAI: Decentralized Training and Deploying LLMs with Massive Consumer-Level GPUs

Zhenheng Tang, Yuxin Wang, Xin He +8

The rapid growth of memory and computation requirements of large language models (LLMs) has outpaced the development of hardware, hindering people who lack large-scale high-end GPU…