activity
20212026
most citedLearning the Relation between Similarity Loss and Clustering Loss in Self-Supervised Learning

11 citations · 11 across the 3 of their papers we have counts for

collaborators
Showing 2021Show all

1 paper · 1 filter

cs.CV2021

Delving into Variance Transmission and Normalization: Shift of Average Gradient Makes the Network Collapse

Yuxiang Liu, Jidong Ge, Chuanyi Li +1

Normalization operations are essential for state-of-the-art neural networks and enable us to train a network from scratch with a large learning rate (LR). We attempt to explain the…