297 citations · 366 across the 9 of their papers we have counts for
Showing 2022 · cs.CVShow all
2 papers · 2 filters
cs.CV2022★ 8 cited
Efficient Image Generation with Variadic Attention Heads
Steven Walton, Ali Hassani, Xingqian Xu +2
While the integration of transformers in vision models have yielded significant improvements on vision tasks they still require significant amounts of computation for both training…
cs.CV2022★ 5 cited
Neighborhood Attention Transformer
Ali Hassani, Steven Walton, Jiachen Li +2
We present Neighborhood Attention (NA), the first efficient and scalable sliding-window attention mechanism for vision. NA is a pixel-wise operation, localizing self attention (SA)…