1 citations · 2 across the 9 of their papers we have counts for
5 papers · 1 filter
Data Strategies for Large Language Models: A Unified Perspective on the Training Lifecycle
Yuanjian Xu, Jianing Hao, Tianze Sun +7
Data strategy plays a central role in training large language models (LLMs). It governs the selection, weighting, and scheduling of training data, thereby determining the capabilit…
Skill-Use: Can LLMs Actually Use Skills in Agentic Harnesses?
Jinyi Han, Yuanjian Xu, Ying Liao +6
Large language model (LLM) agents increasingly rely on skills, structured documents that specify when to act, which procedure to follow, and which tools are allowed. Existing evalu…
Towards Efficient LLMs Annealing with Principled Sample Selection
Yuanjian Xu, Jianing Hao, Wanbo Zhang +2
The annealing phase is a pivotal convergence stage in LLM pre-training that ultimately determines final model quality. However, effectively selecting training data during this phas…
D: Dynamic Directional Graph-Constrained Data Scheduling for LLM Training
Yuanjian Xu, Jianing Hao, Guang Zhang +1
Training data plays a central role in large language models (LLMs) optimization, motivating extensive research on data scheduling strategies. Most existing approaches concentrate o…
Rethinking Data Mixing from the Perspective of Large Language Models
Yuanjian Xu, Tianze Sun, Changwei Xu +7
Data mixing strategy is essential for large language model (LLM) training. Empirical evidence shows that inappropriate strategies can significantly reduce generalization. Although…