Showing math.AGShow all
2 papers · 1 filter
math.AG2026
Algebraic Invariants of Lightning Self-Attention
Yulia Alexandr, Hao Duan, Guido Montúfar
We study the polynomial coefficients of lightning self-attention as coordinates of an algebraic variety. In the single-token case, we characterize the coefficient variety as a rank…
math.AG2025
Constraining the outputs of ReLU neural networks
Yulia Alexandr, Guido Montúfar
We introduce a class of algebraic varieties naturally associated with ReLU neural networks, arising from the piecewise linear structure of their outputs across activation regions i…