State-offset Tuning: State-based Parameter-Efficient Fine-Tuning for State Space Models

Wonjun Kang, Kevin Galim, Yuchen Zeng +3

State Space Models (SSMs) have emerged as efficient alternatives to Transformers, mitigating their quadratic computational cost. However, the application of Parameter-Efficient Fin…