43 citations · 78 across the 8 of their papers we have counts for
8 papers
Transformers meet Neural Algorithmic Reasoners
Wilfried Bounsi, Borja Ibarz, Andrew Dudzik +5
Transformers have revolutionized machine learning with their simple yet effective architecture. Pre-training Transformers on massive text datasets from the Internet has led to unma…
Position: Categorical Deep Learning is an Algebraic Theory of All Architectures
Bruno Gavranović, Paul Lessard, Andrew Dudzik +3
We present our position on the elusive quest for a general-purpose framework for specifying and studying deep learning architectures. Our opinion is that the key attempts made so f…
Asynchronous Algorithmic Alignment with Cocycles
Andrew Dudzik, Tamara von Glehn, Razvan Pascanu +1
State-of-the-art neural algorithmic reasoners make use of message passing in graph neural networks (GNNs). But typical GNNs blur the distinction between the definition and invocati…
A Generalist Neural Algorithmic Learner
Borja Ibarz, Vitaly Kurin, George Papamakarios +12
The cornerstone of neural algorithmic reasoning is the ability to solve algorithmic tasks, especially in a way that generalises out of distribution. While recent years have seen a…
Graph Neural Networks are Dynamic Programmers
Andrew Dudzik, Petar Veličković
Recent advances in neural algorithmic reasoning with graph neural networks (GNNs) are propped up by the notion of algorithmic alignment. Broadly, a neural network will be better at…
Imitating Interactive Intelligence
Josh Abramson, Arun Ahuja, Iain Barr +26
A common vision from science fiction is that robots will one day inhabit our physical spaces, sense the world as we do, assist our physical labours, and communicate with us through…
Quantales and Hyperstructures: Monads, Mo' Problems
Andrew Dudzik
We present a theory of lattice-enriched semirings, called quantic semirings, which generalize both quantales and powersets of hyperrings. Using these structures, we show how to rec…
Embeddings and immersions of tropical curves
Dustin Cartwright, Andrew Dudzik, Madhusudan Manjunath +1
We construct immersions of trivalent abstract tropical curves in the Euclidean plane and embeddings of all abstract tropical curves in higher dimensional Euclidean space. Since not…