10 citations · 11 across the 5 of their papers we have counts for
3 papers · 1 filter
Algebraic Positional Encodings
Konstantinos Kogkalidis, Jean-Philippe Bernardy, Vikas Garg
We introduce a novel positional encoding strategy for Transformer-style models, addressing the shortcomings of existing, often ad hoc, approaches. Our framework provides a flexible…
Going beyond persistent homology using persistent homology
Johanna Immonen, Amauri H. Souza, Vikas Garg
Representational limits of message-passing graph neural networks (MP-GNNs), e.g., in terms of the Weisfeiler-Leman (WL) test for isomorphism, are well understood. Augmenting these…
Compositional Sculpting of Iterative Generative Processes
Timur Garipov, Sebastiaan De Peuter, Ge Yang +3
High training costs of generative models and the need to fine-tune them for specific tasks have created a strong interest in model reuse and composition. A key challenge in composi…