LLM360 K2: Building a 65B 360-Open-Source Large Language Model from Scratch

Zhengzhong Liu, Bowen Tan, Hongyi Wang +22

We detail the training of the LLM360 K2-65B model, scaling up our 360-degree OPEN SOURCE approach to the largest and most powerful models under project LLM360. While open-source LL…