Blockwise Self-Supervised Learning at Scale

Shoaib Ahmed Siddiqui, David Krueger, Yann LeCun +1

Current state-of-the-art deep networks are all powered by backpropagation. In this paper, we explore alternatives to full backpropagation in the form of blockwise learning rules, l…