Prescriptive SVD-Inspired Attention via Spectral Energy Retention

Vasileios Arampatzakis, Vasileios Sevetlidis, George Pavlidis

Self-attention is central to modern Transformer architectures, but its dense dot-product formulation makes it difficult to identify which internal directions are structurally impor…