Showing cs.DCShow all
3 papers · 1 filter
cs.DC2026
SlideDP: Scaling Host-Resident LLM Fine-Tuning Across Multiple GPUs
Ruijia Yang, Shiyuan Lin, Yulong Ao +5
Host-resident layer streaming enables full-parameter LLM fine-tuning beyond GPU memory, but data-parallel ranks compete for shared host resources. Replicated transfers amplify traf…
cs.DC2026
Quasar: Quantized Self-Speculative Acceleration for Rapid Inference via Memory-Efficient Verification
Guang Huang, Zeyi Wen
Speculative Decoding (SD) has emerged as a premier technique for accelerating Large Language Model (LLM) inference by decoupling token generation into rapid drafting and parallel v…
cs.DC2026
An Efficient Heterogeneous Co-Design for Fine-Tuning on a Single GPU
Ruijia Yang, Zeyi Wen
Fine-tuning Large Language Models (LLMs) has become essential for domain adaptation, but its memory-intensive property exceeds the capabilities of most GPUs. To address this challe…