A Parametric Linear Conic Projection for Structured Sparse Attention

Michel Barlaud, Clement Genninasca, Maxime Zanella +2

In this paper, we introduce the Cone Alignment Index (CAI), a scale-invariant sparsity measure associated with a Lorentz-cone geometry. We provide a probabilistic analysis of the d…