2 papers
cs.CL2026
RoPE is Dead, Long Live RoPE: Towards Scalable Data-aware Positional Encodings
Jarod Lévy, Mathurin Videau, Jad Yehya +3
Transformers process tokens without any inherent notion of order, making positional encoding a fundamental requirement rather than an architectural refinement. Rotary Position Embe…
cs.LG2025
RoseCDL: Robust and Scalable Convolutional Dictionary Learning for Rare event and Anomaly Detection
Jad Yehya, Mansour Benbakoura, Cédric Allain +3
Detecting rare events and anomalies in large-scale signals is essential in fields such as astronomy, physical simulations, and biomedical science. In many cases, this problem natur…