1 citations · 2 across the 12 of their papers we have counts for
13 papers
A Compositional Theory of Causally Masked Transformers
Franz Nowak, Ryan Cotterell, Reda Boumasmoud
What types of decision problems can a causally masked, finite-precision transformer solve for inputs of arbitrary length? Existing answers often rely on idealized arithmetic, but u…
Causally Evaluating the Learnability of Formal Language Tasks
Vésteinn Snæbjarnarson, Anej Svete, Josef Valvoda +3
Language models, as multi-task learners, acquire a wide range of abilities during training. A fundamental question is how much task-specific data is needed to learn a given task. A…
An Algebraic View of the Expressivity of Recurrent Language Models
Franz Nowak, Ryan Cotterell, Reda Boumasmoud
What formal languages can a recurrent neural language model recognize? Formal results in the literature conflict: some authors report Turing-completeness, while others show equival…
Transducing Language Models
Vésteinn Snæbjarnarson, Samuel Kiegeland, Tianyu Liu +3
Modern language models define distributions over strings, but downstream tasks often require different output formats. For instance, a model that generates byte-pair strings does n…
An Algorithm for Deterministic Weighted Regular Languages
Clemente Pasti, Talu Karagöz, Anej Svete +3
Extracting finite state automata (FSAs) from black-box models offers a powerful approach to gaining interpretable insights into complex model behaviors. To support this pursuit, we…
On Affine Homotopy between Language Encoders
Robin SM Chan, Reda Boumasmoud, Anej Svete +8
Pre-trained language encoders -- functions that represent text as vectors -- are an integral component of many NLP tasks. We tackle a natural question in language encoder analysis:…
The center of Hecke algebras of types
Reda Boumasmoud, Radhika Ganapathy
We describe the center of the Hecke algebra of a type attached to a Bernstein block under some hypothesis. When is a connected reductive group over non-archimedean local fi…
General Horizontal Norm Compatible Systems on unitary Shimura varieties
Reda Boumasmoud
The ultimate goal of the paper is to construct a novel norm-compatible family of cycles appearing in the context of Gross--Gan--Prasad cycles arising from Shimura varieties attache…
Seed Relations for Eichler--Shimura congruences and Euler systems
Reda Boumasmoud
This paper proves that the -operator attached to a cocharacter is a right root of the corresponding Hecke polynomial. This result is an important ingredient in the proo…
The ring of U-operators: Definitions and Integrality
Reda Boumasmoud
In this paper, we define and study the arithmetic of the ring of -operators for reductive -adic groups. These operators generalise the notion of "successor" operator…
A tale of parahoric--Hecke algebras, Bernstein and Satake homomorphisms
Reda Boumasmoud
Let be a connected reductive group over a {non-archimedean local field} . Let be the parahoric subgroup attached to a facet in the Bru…
Horizontal Distribution Relations for Special Cycles on Unitary Shimura Varieties: Split Case
Reda Boumasmoud, Ernest Hunter Brooks, Dimitar Jetchev
We study the local behavior of special cycles on Shimura varieties for in the setting of the Gan-Gross-Prasad conjectures at primes o…
Vertical Distribution Relations For Special Cycles on Unitary Shimura Varieties
Reda Boumasmoud, Ernest Hunter Brooks, Dimitar Jetchev
We consider cycles on a 3-dimensional Shimura varieties attached to a unitary group, defined over extensions of a CM field , which appear in the context of the conjectures of Ga…