Showing cs.DCShow all
2 papers · 1 filter
cs.DC2026
Schedule-Level Shared-Prefix Reuse for LLM RL Training
Pengbo Li, Feiyuan Zhang, Guangming Sheng +7
GRPO-based LLM post-training commonly samples multiple trajectories from the same prompt and then trains on the resulting group. In long-context GRPO workloads, this shared prompt-…
cs.DC2024
LoHan: Low-Cost High-Performance Framework to Fine-Tune 100B Model on a Consumer GPU
Changyue Liao, Mo Sun, Zihan Yang +5
Nowadays, AI researchers become more and more interested in fine-tuning a pre-trained LLM, whose size has grown to up to over 100B parameters, for their downstream tasks. One appro…