15 citations · 18 across the 4 of their papers we have counts for
1 paper · 2 filters
Max Staats, Matthias Thamm, Bernd Rosenow
This work analyzes singular-value spectra of weight matrices in pretrained transformer models to understand how information is stored at both ends of the spectrum. Using Random Mat…