184 citations · 489 across the 31 of their papers we have counts for
1 paper · 1 filter
Stefan Heimersheim
The LayerNorm (LN) layer in GPT-style transformer models has long been a hindrance to mechanistic interpretability. LN is a crucial component required to stabilize the training of…