2 papers
cs.DC2026
SPORK: Self-Speculative Forking to Accelerate Agentic LLM Inference
Huajun Bai, Weiwei Lv, Huichuan Zheng +2
LLM agents are becoming a common interface for research, coding, and question answering, yet their Thought-Action-Observation loop is often serial: the model reasons, emits a tool…
cs.DC2026
Efficient Training on Multiple Consumer GPUs with RoundPipe
Yibin Luo, Shiwei Gao, Huichuan Zheng +2
Fine-tuning Large Language Models (LLMs) on consumer-grade GPUs is highly cost-effective, yet constrained by limited GPU memory and slow PCIe interconnects. Pipeline parallelism co…