35 citations · 67 across the 9 of their papers we have counts for
1 paper · 1 filter
Robert Kwiatkowski, Oscar Chang
In this paper we introduce a novel method of gradient normalization and decay with respect to depth. Our method leverages the simple concept of normalizing all gradients in a deep…