Theory-Guided Instance-Dependent Early Stopping via Second-Order Loss Dynamics

Ahad Bin Islam Shoeb, Jamal Uddin Tanvin, Kamrul Hasan +2

Instance-dependent early stopping (IES) reduces training computation by skipping backpropagation for examples whose losses have stabilized, but the second-order loss-difference cri…