3 citations · 3 across the 2 of their papers we have counts for
2 papers
cs.AI2023★ 3 cited
Causal Interpretation of Self-Attention in Pre-Trained Transformers
Raanan Y. Rohekar, Yaniv Gurwicz, Shami Nisimov
We propose a causal interpretation of self-attention in the Transformer neural network architecture. We interpret self-attention as a mechanism that estimates a structural equation…
cs.AI2023
From Temporal to Contemporaneous Iterative Causal Discovery in the Presence of Latent Confounders
Raanan Y. Rohekar, Shami Nisimov, Yaniv Gurwicz +1
We present a constraint-based algorithm for learning causal structures from observational time-series data, in the presence of latent confounders. We assume a discrete-time, statio…