28 citations · 28 across the 2 of their papers we have counts for
2 papers
cs.LG2026
Symmetry Breaking in Transformers for Efficient and Interpretable Training
Eva Silverstein, Daniel Kunin, Vasudev Shyam
The attention mechanism in its standard implementation contains extraneous rotational degrees of freedom that are carried through computation but do not affect model activations or…
hep-th1998★ 28 cited
On the Matrix Description of Calabi-Yau Compactifications
S. Kachru, A. Lawrence, E. Silverstein
We point out that the matrix description of M-theory compactified on Calabi-Yau threefolds is in many respects simpler than the matrix description of a compactification. This…