1 paper
Boxun Li, Yadong Li, Zhiyuan Li +12
We present Megrez2, a novel lightweight and high-performance language model architecture optimized for device native deployment. Megrez2 introduces a novel cross-layer expert shari…