4 papers · 1 filter
Pattern Formation in Transformers
Erkan Turan, Gaspard Abel, Maks Ovsjanikov
What are the inductive biases of a Transformer architecture? Existing theory on how the forward pass shapes representations either considers whether Transformers escape from rank c…
Algorithmic collusion under asynchronous price updating
Ivan Conjeaud, Gaspard Abel, Argyris Kalogeratos
This paper investigates the effect of asynchrony in agents' updates in the emergence of algorithmic collusion. We present a continuous-time model for algorithmic collusion in which…
Dual-Criterion Curriculum Learning: Application to Temporal Data
Gaspard Abel, Eloi Campagne, Mohamed Benloughmari +1
Curriculum Learning (CL) is a meta-learning paradigm that trains a model by feeding the data instances incrementally according to a schedule, which is based on difficulty progressi…
Beyond ReLU: Bifurcation, Oversmoothing, and Topological Priors
Erkan Turan, Gaspard Abel, Maysam Behmanesh +2
Graph Neural Networks (GNNs) learn node representations through iterative network-based message-passing. While powerful, deep GNNs suffer from oversmoothing, where node features co…