Learning distant cause and effect using only local and immediate credit assignment

David Rawlinson, Abdelrahman Ahmed, Gideon Kowadlo

We present a recurrent neural network memory that uses sparse coding to create a combinatoric encoding of sequential inputs. Using several examples, we show that the network can as…