A Mathematical Theory of Top-$k$ Sparse Attention via Total Variation Distance

Georgios Tzachristas, Lei Deng, Ioannis Tzachristas +2

We develop a unified mathematical framework for certified Top-$k$ attention truncation that quantifies approximation error at both the distribution and output levels. For a single…