Showing math.AGShow all
2 papers · 1 filter
math.AG2026
Constraining the outputs of ReLU neural networks
Yulia Alexandr, Guido Montúfar
We introduce a class of algebraic varieties naturally associated with ReLU neural networks, arising from the piecewise linear structure of their outputs across activation regions i…
math.AG2026
Algebraic Invariants of Lightning Self-Attention
Yulia Alexandr, Hao Duan, Guido Montúfar
We study the polynomial coefficients of lightning self-attention as coordinates of an algebraic variety. We identify linear and nonlinear families of algebraic invariants, includin…