7 citations · 21 across the 8 of their papers we have counts for
Showing 2024Show all
3 papers · 1 filter
cs.LG2024
Disentangling and Integrating Relational and Sensory Information in Transformer Architectures
Awni Altabaa, John Lafferty
Relational reasoning is a central component of generally intelligent systems, enabling robust and data-efficient inductive generalization. Recent empirical evidence shows that many…
cs.LG2024
On the Role of Information Structure in Reinforcement Learning for Partially-Observable Sequential Teams and Games
Awni Altabaa, Zhuoran Yang
In a sequential decision-making problem, the information structure is the description of how events in the system occurring at different points in time affect each other. Classical…
cs.LG2024★ 2 cited
Approximation of relation functions and attention mechanisms
Awni Altabaa, John Lafferty
Inner products of neural network feature maps arise in a wide variety of machine learning frameworks as a method of modeling relations between inputs. This work studies the approxi…