Showing cs.AIShow all
2 papers · 1 filter
cs.AI2026
From Attention Masks to Inert Zero-Vector Tokens: OAttention and O-Closure for Token Dynamics
Heyang Gong
Attention masks are relation-level controls: they specify which query--source pairs may interact. They do not provide a representation-carried token state that is non-participating…
cs.AI2024
Distribution-consistency Structural Causal Models
Heyang Gong, Chaochao Lu, Yu Zhang
In the field of causal modeling, potential outcomes (PO) and structural causal models (SCMs) stand as the predominant frameworks. However, these frameworks face notable challenges…