1 citations · 1 across the 6 of their papers we have counts for
1 paper · 1 filter
Yuhao Zhou, Sirui Song, Boyang Liu +6
Rotary Position Embedding (RoPE) enables each attention head to capture multi-frequency information along the sequence dimension and is widely applied in foundation models. However…