4 papers
Exact Causal Attention with 10% Fewer Operations
Dmitry Rybin, Yushun Zhang, Ding Tian +2
We present Exact Causal Attention (ECA), a Strassen-style algorithm that computes exact Causal Attention using 10\% fewer operations. ECA improves a special class of matrix multipl…
Can Be Faster
Dmitry Rybin, Yushun Zhang, Zhi-Quan Luo
We present RXTX, a new algorithm for computing the product of matrix by its transpose for . RXTX uses fewer multiplications and fe…
Finite Horizon Optimization: Framework and Applications
Yushun Zhang, Dmitry Rybin, Zhi-Quan Luo
In modern engineering scenarios, there is often a strict upper bound on the number of algorithm iterations that can be performed within a given time limit. This raises the question…
FFLV polytopes for odd symplectic Lie algebras
Dmitry Rybin
We consider "odd symplectic Lie algebras" defined in terms of maximal rank skew-symmetric forms. We provide FFLV polytopes for these algebras and prove their standard properties. I…