Near-Floor Geometry Is Generic: Leverage Dispersion in Trained Overcomplete Codes

Hector Borobia, Elies Seguí-Mas, Guillermina Tormo-Carbó

An overcomplete code packs $F$ features into $d<F$ dimensions, so linear readout of one feature picks up cross-talk from the others, bounded below by the rank-trace floor $W(F,d)=(…