9 citations · 10 across the 4 of their papers we have counts for
Showing 2021Show all
2 papers · 1 filter
cs.CL2021
The Importance of the Current Input in Sequence Modeling
Christian Oliva, Luis F. Lago-Fernández
The last advances in sequence modeling are mainly based on deep learning approaches. The current state of the art involves the use of variations of the standard LSTM architecture,…
cs.LG2021★ 1 cited
Backward Gradient Normalization in Deep Neural Networks
Alejandro Cabana, Luis F. Lago-Fernández
We introduce a new technique for gradient normalization during neural network training. The gradients are rescaled during the backward pass using normalization layers introduced at…