3 citations · 3 across the 5 of their papers we have counts for
Showing 2026Show all
3 papers · 1 filter
cs.CL2026
TrajLong: Co-Designing Agentic and Long-Context Supervision for Mid-Training
Miao Peng, Qintong Zhang, Nuo Chen +8
LLM agents for coding, search, and workplace tasks increasingly rely on long-context capabilities to effectively aggregate and reason over extended interaction histories. Recent wo…
cs.AI2026
Scaling Domain Data Repetition in LLM Pretraining
Jingwei Li, Xinran Gu, Rui Dai +5
As large language models scale, their training-token budgets must also increase to maintain an appropriate tokens-per-parameter ratio (\(\mathrm{TPP}\)). However, high-quality doma…
cs.LG2026
Capacity-Aware Mixture Law Enables Efficient LLM Data Optimization
Jingwei Li, Xinran Gu, Jingzhao Zhang
A data mixture refers to how different data sources are combined to train large language models, and selecting an effective mixture is crucial for optimal downstream performance. E…