DeInfoReg: A Decoupled Learning Framework for Better Training Throughput

Zih-Hao Huang, You-Teng Lin, Hung-Hsuan Chen

This paper introduces Decoupled Supervised Learning with Information Regularization (DeInfoReg), a novel approach that transforms a long gradient flow into multiple shorter ones, t…