Heracles: A Hybrid SSM-Transformer Model for High-Resolution Image and Time-Series Analysis

Badri N. Patro, Suhas Ranganath, Vinay P. Namboodiri +1

Transformers have revolutionized image modeling tasks with adaptations like DeIT, Swin, SVT, Biformer, STVit, and FDVIT. However, these models often face challenges with inductive…