Showing cs.CLShow all
2 papers · 1 filter
cs.CL2024
Untie the Knots: An Efficient Data Augmentation Strategy for Long-Context Pre-Training in Language Models
Junfeng Tian, Da Zheng, Yang Cheng +3
Large language models (LLM) have prioritized expanding the context window from which models can incorporate more information. However, training models to handle long contexts prese…
cs.CL2024
Nyonic Technical Report
Junfeng Tian, Rui Wang, Cong Li +3
This report details the development and key achievements of our latest language model designed for custom large language models. The advancements introduced include a novel Online…