2 citations · 3 across the 2 of their papers we have counts for
1 paper · 1 filter
Faisal Al-Khateeb, Nolan Dey, Daria Soboleva +1
Linear position interpolation helps pre-trained models using rotary position embeddings (RoPE) to extrapolate to longer sequence lengths. We propose using linear position interpola…