7 citations · 7 across the 2 of their papers we have counts for
Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
Jordan-RoPE: Non-Semisimple Relative Positional Encoding via Complex Jordan Blocks
Yaobo Zhang
Relative positional encodings determine which functions of query-key lag can enter the primitive attention logit. RoPE supplies a rotary phase, while ALiBi supplies an additive dis…
cs.LG2020
Depth-Width Trade-offs for Neural Networks via Topological Entropy
Kaifeng Bu, Yaobo Zhang, Qingxian Luo
One of the central problems in the study of deep learning theory is to understand how the structure properties, such as depth, width and the number of nodes, affect the expressivit…