15 citations · 65 across the 17 of their papers we have counts for
3 papers · 1 filter
Learning Dynamics of Chain-of-Thought State Tracking in a Solvable Transformer Model
Niklas Forner, Marcel Kühn, Matthias Thamm +1
Chain-of-thought generation can turn a multi-step computation into a sequence of locally checkable state updates, but the training dynamics by which transformers acquire such updat…
Boundary between noise and information applied to filtering neural network weight matrices
Max Staats, Matthias Thamm, Bernd Rosenow
Deep neural networks have been successfully applied to a broad range of problems where overparametrization yields weight matrices which are partially random. A comparison of weight…
Random matrix analysis of deep neural network weight matrices
Matthias Thamm, Max Staats, Bernd Rosenow
Neural networks have been used successfully in a variety of fields, which has led to a great deal of interest in developing a theoretical understanding of how they store the inform…