CommuteProp: Decoupled Training for Communication Bound Split LLM Fine-Tuning

CHEN Ding, LUO Haochen, LIU Chen

Split learning has emerged as a promising paradigm for privacy-preserving LLM fine-tuning, yet its practical deployment is severely hindered by the sequential communication-computa…