15 citations · 28 across the 31 of their papers we have counts for
1 paper · 1 filter
Xavier Suau, Luca Zappella, Nicholas Apostoloff
In this work we study the presence of expert units in pre-trained Transformer Models (TM), and how they impact a model's performance. We define expert units to be neurons that are…