27 citations · 65 across the 13 of their papers we have counts for
3 papers · 1 filter
AI Foundation Model for Heliophysics: Applications, Design, and Implementation
Sujit Roy, Talwinder Singh, Marcus Freitag +14
Deep learning-based methods have been widely researched in the areas of language and vision, demonstrating their capacity to understand long sequences of data and their usefulness…
Mamba-360: Survey of State Space Models as Transformer Alternative for Long Sequence Modelling: Methods, Applications, and Challenges
Badri Narayana Patro, Vijay Srinivas Agneeswaran
Sequence modeling is a crucial area across various domains, including Natural Language Processing (NLP), speech recognition, time series forecasting, music generation, and bioinfor…
SiMBA: Simplified Mamba-Based Architecture for Vision and Multivariate Time series
Badri N. Patro, Vijay S. Agneeswaran
Transformers have widely adopted attention networks for sequence mixing and MLPs for channel mixing, playing a pivotal role in achieving breakthroughs across domains. However, rece…