5 citations · 5 across the 1 of their papers we have counts for
2 papers
cs.LG2021★ 5 cited
Language Modeling using LMUs: 10x Better Data Efficiency or Improved Scaling Compared to Transformers
Narsimha Chilkuri, Eric Hunsberger, Aaron Voelker +2
Recent studies have demonstrated that the performance of transformers on the task of language modeling obeys a power-law relationship with model size over six orders of magnitude.…
cs.LG2021
Parallelizing Legendre Memory Unit Training
Narsimha Chilkuri, Chris Eliasmith
Recently, a new recurrent neural network (RNN) named the Legendre Memory Unit (LMU) was proposed and shown to achieve state-of-the-art performance on several benchmark datasets. He…