2 papers
cs.LG2026
The Rank the Task Demands: A Causal Rank Law for Matrix Memories Trained on Group Composition
Samuel Larson
Matrix-valued memories make rank the natural budget of a learned representation: the number of independent directions a state spans bounds what it can bind, compose, and track. We…
cs.LG2026
The Gradient Does Not See Rank: Rank-Indifference in Matrix-CODI on ProsQA
Samuel Larson
Continuous chain-of-thought models compress reasoning into latent tokens. Matrix-valued variants, which route each latent token through a d x d matrix bottleneck, introduce rank as…