465 citations · 1.5k across the 12 of their papers we have counts for
Showing 2019Show all
2 papers · 1 filter
cs.LG2019
Long Distance Relationships without Time Travel: Boosting the Performance of a Sparse Predictive Autoencoder in Sequence Modeling
Jeremy Gordon, David Rawlinson, Subutai Ahmad
In sequence learning tasks such as language modelling, Recurrent Neural Networks must learn relationships between input features separated by time. State of the art models such as…
cs.LG2019★ 64 cited
How Can We Be So Dense? The Benefits of Using Highly Sparse Representations
Subutai Ahmad, Luiz Scheinkman
Most artificial networks today rely on dense representations, whereas biological networks rely on sparse representations. In this paper we show how sparse representations can be mo…