4 citations · 13 across the 32 of their papers we have counts for
Showing cs.AIShow all
2 papers · 1 filter
cs.AI2024
PIDformer: Transformer Meets Control Theory
Tam Nguyen, César A. Uribe, Tan M. Nguyen +1
In this work, we address two main shortcomings of transformer architectures: input corruption and rank collapse in their output representation. We unveil self-attention as an auton…
cs.AI2023★ 4 cited
Perspectives on the State and Future of Deep Learning - 2023
Micah Goldblum, Anima Anandkumar, Richard Baraniuk +7
The goal of this series is to chronicle opinions and issues in the field of machine learning as they stand today and as they change over time. The plan is to host this survey perio…