2 citations · 2 across the 3 of their papers we have counts for
Showing 2023Show all
2 papers · 1 filter
cs.LG2023
What Formal Languages Can Transformers Express? A Survey
Lena Strobl, William Merrill, Gail Weiss +2
As transformers have gained prominence in natural language processing, some researchers have investigated theoretically what problems they can and cannot solve, by treating problem…
cs.CL2023★ 2 cited
Average-Hard Attention Transformers are Constant-Depth Uniform Threshold Circuits
Lena Strobl
Transformers have emerged as a widely used neural network model for various natural language processing tasks. Previous research explored their relationship with constant-depth thr…