542 citations · 1.1k across the 17 of their papers we have counts for
3 papers · 1 filter
SequenceLayers: Sequence Processing and Streaming Neural Networks Made Easy
RJ Skerry-Ryan, Julian Salazar, Soroosh Mariooryad +8
We introduce a neural network layer API and library for sequence modeling, designed for easy creation of sequence models that can be executed both layer-by-layer (e.g., teacher-for…
Non-saturating GAN training as divergence minimization
Matt Shannon, Ben Poole, Soroosh Mariooryad +5
Non-saturating generative adversarial network (GAN) training is widely used and has continued to obtain groundbreaking results. However so far this approach has lacked strong theor…
Complex Evolution Recurrent Neural Networks (ceRNNs)
Izhak Shafran, Tom Bagby, R. J. Skerry-Ryan
Unitary Evolution Recurrent Neural Networks (uRNNs) have three attractive properties: (a) the unitary property, (b) the complex-valued nature, and (c) their efficient linear operat…