Training Report of TeleChat3-MoE

Xinzhang Liu, Chao Wang, Zhihao Yang +51

TeleChat3-MoE is the latest series of TeleChat large language models, featuring a Mixture-of-Experts (MoE) architecture with parameter counts ranging from 105 billion to over one t…