1 citations · 1 across the 4 of their papers we have counts for
1 paper · 1 filter
Tam Nguyen, César A. Uribe, Tan M. Nguyen +1
In this work, we address two main shortcomings of transformer architectures: input corruption and rank collapse in their output representation. We unveil self-attention as an auton…