RingFormer: Rethinking Recurrent Transformer with Adaptive Level Signals

Jaemu Heo, Eldor Fozilov, Hyunmin Song +1

Transformers have achieved great success in effectively processing sequential data such as text. Their architecture consisting of several attention and feedforward blocks can model…