CoLLiE: Collaborative Training of Large Language Models in an Efficient Way

Kai Lv, Shuo Zhang, Tianle Gu +11

Large language models (LLMs) are increasingly pivotal in a wide range of natural language processing tasks. Access to pre-trained models, courtesy of the open-source community, has…