Accelerating Multi-Scale Deformable Attention Using Near-Memory-Processing Architecture

Huize Li, Qinggang Wang, Bing Gao +3

Multi Scale Deformable Attention (MSDAttn) has become a fundamental component in various vision tasks due to its effective multi scale grid sampling (MSGS). However, its reliance o…