Why Layer-Wise Learning is Hard to Scale-up and a Possible Solution via Accelerated Downsampling

Wenchi Ma, Miao Yu, Kaidong Li +1

Layer-wise learning, as an alternative to global back-propagation, is easy to interpret, analyze, and it is memory efficient. Recent studies demonstrate that layer-wise learning ca…