19 citations · 36 across the 6 of their papers we have counts for
3 papers · 1 filter
Breaking Time Invariance: Assorted-Time Normalization for RNNs
Cole Pospisil, Vasily Zadorozhnyy, Qiang Ye
Methods such as Layer Normalization (LN) and Batch Normalization (BN) have proven to be effective in improving the training of Recurrent Neural Networks (RNNs). However, existing m…
Orthogonal Gated Recurrent Unit with Neumann-Cayley Transformation
Edison Mucllari, Vasily Zadorozhnyy, Cole Pospisil +2
In recent years, using orthogonal matrices has been shown to be a promising approach in improving Recurrent Neural Networks (RNNs) with training, stability, and convergence, partic…
Symmetry Structured Convolutional Neural Networks
Kehelwala Dewage Gayan Maduranga, Vasily Zadorozhnyy, Qiang Ye
We consider Convolutional Neural Networks (CNNs) with 2D structured features that are symmetric in the spatial dimensions. Such networks arise in modeling pairwise relationships fo…