Analytic-Walk Rotary Positional Encodings for Graphs

Jiaqing Xie, Yuxin Wang, Xipeng Qiu

Rotary position encodings make attention sensitive to relative position, but extending them to graphs requires choosing how graph structure enters the rotation. Previous works assi…