14 citations · 39 across the 9 of their papers we have counts for
3 papers · 1 filter
Causal Interpretation of Self-Attention in Pre-Trained Transformers
Raanan Y. Rohekar, Yaniv Gurwicz, Shami Nisimov
We propose a causal interpretation of self-attention in the Transformer neural network architecture. We interpret self-attention as a mechanism that estimates a structural equation…
From Temporal to Contemporaneous Iterative Causal Discovery in the Presence of Latent Confounders
Raanan Y. Rohekar, Shami Nisimov, Yaniv Gurwicz +1
We present a constraint-based algorithm for learning causal structures from observational time-series data, in the presence of latent confounders. We assume a discrete-time, statio…
A Single Iterative Step for Anytime Causal Discovery
Raanan Y. Rohekar, Yaniv Gurwicz, Shami Nisimov +1
We present a sound and complete algorithm for recovering causal graphs from observed, non-interventional data, in the possible presence of latent confounders and selection bias. We…