Showing cs.CLShow all
2 papers · 1 filter
cs.CL2024
Xmodel-1.5: An 1B-scale Multilingual LLM
Wang Qun, Liu Yang, Lin Qingquan +1
We introduce Xmodel-1.5, a 1-billion-parameter multilingual large language model pretrained on 2 trillion tokens, designed for balanced performance and scalability. Unlike most lar…
cs.CL2024
Xmodel-LM Technical Report
Yichuan Wang, Yang Liu, Yu Yan +3
We introduce Xmodel-LM, a compact and efficient 1.1B language model pre-trained on around 2 trillion tokens. Trained on our self-built dataset (Xdata), which balances Chinese and E…