7 citations · 8 across the 11 of their papers we have counts for
Showing 2024Show all
2 papers · 1 filter
cs.LG2024
Sparse Mamba: Introducing Controllability, Observability, And Stability To Structural State Space Models
Emadeldeen Hamdan, Hongyi Pan, Ahmet Enis Cetin
Structured state space models' (SSMs) development in recent studies, such as Mamba and Mamba2, outperformed and solved the computational inefficiency of transformers and large lang…
cs.CV2024★ 1 cited
Discrete Cosine Transform Based Decorrelated Attention for Vision Transformers
Hongyi Pan, Emadeldeen Hamdan, Xin Zhu +2
Self-attention is central to the success of Transformer architectures; however, learning the query, key, and value projections from random initialization remains challenging and co…