4 papers
Replacement Learning: Training Neural Networks with Fewer Parameters
Yuming Zhang, Peizhe Wang, Tianyang Han +5
End-to-end training with full-depth backpropagation remains the dominant paradigm for optimizing deep neural networks, but its efficiency deteriorates as models grow deeper. Since…
Advancing Supervised Local Learning Beyond Classification with Long-term Feature Bank
Feiyu Zhu, Yuming Zhang, Xiuyuan Guo +4
Local learning offers an alternative to traditional end-to-end back-propagation in deep neural networks, significantly reducing GPU memory consumption. Although it has shown promis…
MLAAN: Scaling Supervised Local Learning with Multilaminar Leap Augmented Auxiliary Network
Yuming Zhang, Shouxin Zhang, Peizhe Wang +5
Deep neural networks (DNNs) typically employ an end-to-end (E2E) training paradigm which presents several challenges, including high GPU memory consumption, inefficiency, and diffi…
Replacement Learning: Training Vision Tasks with Fewer Learnable Parameters
Yuming Zhang, Peizhe Wang, Shouxin Zhang +3
Traditional end-to-end deep learning models often enhance feature representation and overall performance by increasing the depth and complexity of the network during training. Howe…