3 papers
cs.CL2025
Yi: Open Foundation Models by 01.AI
01. AI, :, Alex Young +30
We introduce the Yi model family, a series of language and multimodal models that demonstrate strong multi-dimensional capabilities. The Yi model family is based on 6B and 34B pret…
cs.AI2024
Read to Play (R2-Play): Decision Transformer with Multimodal Game Instruction
Yonggang Jin, Ge Zhang, Hao Zhao +7
Developing a generalist agent is a longstanding objective in artificial intelligence. Previous efforts utilizing extensive offline datasets from various tasks demonstrate remarkabl…
cs.CL2024
The Fine Line: Navigating Large Language Model Pretraining with Down-streaming Capability Analysis
Chen Yang, Junzhuo Li, Xinyao Niu +11
Uncovering early-stage metrics that reflect final model performance is one core principle for large-scale pretraining. The existing scaling law demonstrates the power-law correlati…