The Gradient Does Not See Rank: Rank-Indifference in Matrix-CODI on ProsQA

Samuel Larson

Continuous chain-of-thought models compress reasoning into latent tokens. Matrix-valued variants, which route each latent token through a d x d matrix bottleneck, introduce rank as…