2 citations · 2 across the 2 of their papers we have counts for
4 papers
The Role of Logic and Automata in Understanding Transformers
Anthony W. Lin, Pablo Barcelo
The advent of transformers has in recent years led to powerful and revolutionary Large Language Models (LLMs). Despite this, our understanding on the capability of transformers is…
Link Prediction with Relational Hypergraphs
Xingyue Huang, Miguel Romero Orth, Pablo Barceló +2
Link prediction with knowledge graphs has been thoroughly studied in graph machine learning, leading to a rich landscape of graph neural network architectures with successful appli…
Logical Languages Accepted by Transformer Encoders with Hard Attention
Pablo Barcelo, Alexander Kozachinskiy, Anthony Widjaja Lin +1
We contribute to the study of formal languages that can be recognized by transformer encoders. We focus on two self-attention mechanisms: (1) UHAT (Unique Hard Attention Transforme…
A Uniform Language to Explain Decision Trees
Marcelo Arenas, Pablo Barcelo, Diego Bustamante +2
The formal XAI community has studied a plethora of interpretability queries aiming to understand the classifications made by decision trees. However, a more uniform understanding o…