70 citations · 120 across the 5 of their papers we have counts for
5 papers
The unreasonable effectiveness of the forget gate
Jos van der Westhuizen, Joan Lasenby
Given the success of the gated recurrent unit, a natural question is whether all the gates of the long short-term memory (LSTM) network are necessary. Previous research has shown t…
Learning a Generative Model for Validity in Complex Discrete Structures
David Janz, Jos van der Westhuizen, Brooks Paige +2
Deep generative models have been successfully used to learn representations for high-dimensional discrete spaces by representing discrete objects as sequences and employing powerfu…
Actively Learning what makes a Discrete Sequence Valid
David Janz, Jos van der Westhuizen, José Miguel Hernández-Lobato
Deep learning techniques have been hugely successful for traditional supervised and unsupervised machine learning problems. In large part, these techniques solve continuous optimiz…
Bayesian LSTMs in medicine
Jos van der Westhuizen, Joan Lasenby
The medical field stands to see significant benefits from the recent advances in deep learning. Knowing the uncertainty in the decision made by any machine learning algorithm is of…
Techniques for visualizing LSTMs applied to electrocardiograms
Jos van der Westhuizen, Joan Lasenby
This paper explores four different visualization techniques for long short-term memory (LSTM) networks applied to continuous-valued time series. On the datasets analysed, we find t…