167 citations · 416 across the 10 of their papers we have counts for
Showing 2017Show all
2 papers · 1 filter
cs.AI2017★ 9 cited
Sparse Attentive Backtracking: Long-Range Credit Assignment in Recurrent Networks
Nan Rosemary Ke, Anirudh Goyal, Olexa Bilaniuk +4
A major drawback of backpropagation through time (BPTT) is the difficulty of learning long-term dependencies, coming from having to propagate credit information backwards through e…
cs.NE2017★ 167 cited
Deep Complex Networks
Chiheb Trabelsi, Olexa Bilaniuk, Ying Zhang +7
At present, the vast majority of building blocks, techniques, and architectures for deep learning are based on real-valued operations and representations. However, recent work on r…