Showing cs.FLShow all
2 papers · 1 filter
cs.FL2026
Transformers are Inherently Succinct
Pascal BergsträÃer, Ryan Cotterell, Anthony W. Lin
We study succinctness as a measure of the expressive power of transformers. Succinctness -- how compactly a formalism can describe a language relative to other formalisms -- is a c…
cs.FL2024
The Power of Hard Attention Transformers on Data Sequences: A Formal Language Theoretic Perspective
Pascal BergsträÃer, Chris Köcher, Anthony Widjaja Lin +1
Formal language theory has recently been successfully employed to unravel the power of transformer encoders. This setting is primarily applicable in Natural Language Processing (NL…