785 citations · 907 across the 9 of their papers we have counts for
Showing 2023Show all
2 papers · 1 filter
cs.LG2023
On the special role of class-selective neurons in early training
Omkar Ranadive, Nikhil Thakurdesai, Ari S Morcos +2
It is commonly observed that deep networks trained for classification exhibit class-selective neurons in their early and intermediate layers. Intriguingly, recent studies have show…
cs.CV2023★ 4 cited
Blockwise Self-Supervised Learning at Scale
Shoaib Ahmed Siddiqui, David Krueger, Yann LeCun +1
Current state-of-the-art deep networks are all powered by backpropagation. In this paper, we explore alternatives to full backpropagation in the form of blockwise learning rules, l…