45 citations · 58 across the 10 of their papers we have counts for
3 papers · 1 filter
Long Distance Relationships without Time Travel: Boosting the Performance of a Sparse Predictive Autoencoder in Sequence Modeling
Jeremy Gordon, David Rawlinson, Subutai Ahmad
In sequence learning tasks such as language modelling, Recurrent Neural Networks must learn relationships between input features separated by time. State of the art models such as…
AHA! an 'Artificial Hippocampal Algorithm' for Episodic Machine Learning
Gideon Kowadlo, Abdelrahman Ahmed, David Rawlinson
The majority of ML research concerns slow, statistical learning of i.i.d. samples from large, labelled datasets. Animals do not learn this way. An enviable characteristic of animal…
Learning distant cause and effect using only local and immediate credit assignment
David Rawlinson, Abdelrahman Ahmed, Gideon Kowadlo
We present a recurrent neural network memory that uses sparse coding to create a combinatoric encoding of sequential inputs. Using several examples, we show that the network can as…