works on
depth scaling 1normalization placement 1rank collapse 1skip connections 1transformer architecture 1

From the 1 of 1 linked paper with an AI index.

collaborators

1 paper

cs.LG2026

Transforming Rank: How Architecture Navigates the Spectral Pathologies of Depth

Katie Everett

The paper analyzes how design choices in Transformer feed‑forward blocks—such as skip connections, normalization placement, and width expansion—affect the preservation of matrix ra…