7 citations · 11 across the 6 of their papers we have counts for
Showing 2024Show all
2 papers · 1 filter
cs.LG2024★ 7 cited
Were RNNs All We Needed?
Leo Feng, Frederick Tung, Mohamed Osama Ahmed +2
The introduction of Transformers in 2017 reshaped the landscape of deep learning. Originally proposed for sequence modelling, Transformers have since achieved widespread success ac…
cs.LG2024★ 3 cited
Attention as an RNN
Leo Feng, Frederick Tung, Hossein Hajimirsadeghi +3
The advent of Transformers marked a significant breakthrough in sequence modelling, providing a highly performant architecture capable of leveraging GPU parallelism. However, Trans…