Not Every Sync Is Safe: Calibrated DiLoCo Scheduling for Shared AI Infrastructure

Maxwell Twelftree, David Lemphers, An-chi He +1

DiLoCo-style training reduces communication by letting learner islands train locally before occasional outer synchronization, making it attractive for fragmented industrial AI flee…