560 citations · 560 across the 3 of their papers we have counts for
1 paper · 1 filter
Jonathan Su
Cross-layer reuse of early attention projections can improve optimization and data efficiency, but it creates a structural conflict: the first layer must simultaneously act as a st…