Gradient Prediction with Control Variates in the Cheap-Forward Regime

Kamil Ciosek, Nicolò Felicioni, Juan Elenter +1

We study whether otherwise-idle inference resources could reduce the scarce-GPU cost of training. Our analysis uses a simulated compute ledger in which fleet work is billed at a fr…