inhibitory mechanisms 1object detection 1out-of-distribution generalization 1robustness 1self-attention 1vision transformers 1
From the 1 of 2 linked papers with an AI index.
2 papers
cs.CV2026
Inhibited Self-Attention: Sharpening Focus in Vision Transformers
Peter R. D. van der Wal, Nicola Strisciuglio, George Azzopardi
The paper proposes Inhibited Self-Attention (ISA), a modification to Vision Transformers that incorporates negative attention scores to suppress background features, leading to sha…
cs.CV2025
Dynamic Sparse Training versus Dense Training: The Unexpected Winner in Image Corruption Robustness
Boqian Wu, Qiao Xiao, Shunxin Wang +5
It is generally perceived that Dynamic Sparse Training opens the door to a new era of scalability and efficiency for artificial neural networks at, perhaps, some costs in accuracy…