Data-Efficient Language Modeling: From Frontier Advancement to Principle-Guided Model Improvement

Shuxing Yang, Kaihao Zhu, Junjie Yang +13

Learning from limited text requires models to use context, generalize to new inputs, and retain useful capabilities. Qiushi Engine conducted a long-horizon, end-to-end autonomous r…