7 citations · 10 across the 5 of their papers we have counts for
Showing 2024 · cs.LGShow all
2 papers · 2 filters
cs.LG2024★ 7 cited
Were RNNs All We Needed?
Leo Feng, Frederick Tung, Mohamed Osama Ahmed +2
The introduction of Transformers in 2017 reshaped the landscape of deep learning. Originally proposed for sequence modelling, Transformers have since achieved widespread success ac…
cs.LG2024★ 3 cited
Attention as an RNN
Leo Feng, Frederick Tung, Hossein Hajimirsadeghi +3
The advent of Transformers marked a significant breakthrough in sequence modelling, providing a highly performant architecture capable of leveraging GPU parallelism. However, Trans…