85 citations · 102 across the 10 of their papers we have counts for
Showing 2023Show all
2 papers · 1 filter
cs.LG2023
Algebraic Positional Encodings
Konstantinos Kogkalidis, Jean-Philippe Bernardy, Vikas Garg
We introduce a novel positional encoding strategy for Transformer-style models, addressing the shortcomings of existing, often ad hoc, approaches. Our framework provides a flexible…
cs.PL2023
Domain-Specific Tensor Languages
Jean-Philippe Bernardy, Patrik Jansson
The tensor notation used in several areas of mathematics is a useful one, but it is not widely available to the functional programming community. In a practical sense, the (embedde…