Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
Inference First, Training Underneath: Layer-Granular LoRA Co-Serving with LayerLoom
Zongpu Zhang, Yishu Yin, Xuehai Qian
Serving and fine-tuning a large language model on the same GPUs can turn the idle capacity between inference bursts into training progress, and low-rank adaptation (LoRA) makes thi…
cs.LG2026
GreedySnake: Accelerating SSD-Offloaded LLM Training with Efficient Scheduling and Optimizer Step Overlapping
Yishu Yin, Xuehai Qian
SSD-offloaded training offers a practical and promising approach to making LLM training cost-effective. Building on gradient accumulation with micro-batches, this paper introduces…