From the 1 of 1 linked paper with an AI index.
1 paper
Yiwen Chen, Joshua Ainslie, Krzysztof Choromanski +4
The paper introduces ClockRoPE, a method that uses random Fourier rotations to create periodic position embeddings for transformers, improving temporal routine modeling in sequenti…