EOE: Evolutionary Optimization of Experts for Training Language Models

Yingshi Chen

This paper presents an evolutionary framework for the training of large language models(LLM). The models are divided into several experts(sub-networks), which have the same structu…