Non-Commutative Lie-Algebraic State-Space Models: Finite-Division Variety Laws, Semidirect Cascades, and Gradient Saddle Escape
arXiv:2610.00329
Abstract
Structured state-space models (SSMs) achieve linear-time inference and logarithmic-time parallel training via associative scans, yet homogeneous diagonal transitions generate solvable semigroups unable to track non-solvable group words or 3D rigid-body manifolds. We develop a theoretical and empirical framework for Non-Commutative Lie-Algebraic State-Space Models (Lie-SSMs), parameterizing recurrent updates on Lie algebra tangent spaces via the matrix exponential. First, via an o-minimal multi-rate cylindrical flag collar, we establish an unconditional single-layer finite-division criterion for homogeneous contracting and heads, proving odd-prime Sylow abelianity, odd--core centrality , exponent-30 commutator laws ( in and in , excluding ), and sharp threshold in . Second, Depth-2 semidirect and Schreier -cocycle cascades resolve , , and in depth, whereas unnormalized contracting coupling collapses exponentially without Directional RMSNorm. Third, we characterize the Chen--Magnus--Hall--Witt commutator saddle and coset-centroid dilution, proving symmetry breaking and local Polyak--Łojasiewicz convergence (), solving ( at ) and () via dense prefix loss and factored readouts. Across , Dyck-2, Left-Jacobian odometry, GPU scans ( speedup), and three 3D IMU cohorts (UCI HAR, HAPT-PT 30-subject CV, and REALDISP), Depth-2 Lie- cascades reach on HAR, ( 30-subject episodes) on HAPT-PT, and under displacement on REALDISP.
arXiv comment33 pages, 4 figures, 11 tables, 2 algorithms; includes 5 ancillary reproducibility and finite-group theorem verification scripts