Automatic Synthesis of Neurons for Recurrent Neural Nets

Roland Olsson, Chau Tran, Lars Magnusson

We present a new class of neurons, ARNs, which give a cross entropy on test data that is up to three times lower than the one achieved by carefully optimized LSTM neurons. The expl…