2 papers
cs.LG2026
LeRoPE: Learnable RoPE Frequencies Improve Language Modeling
Petros Karypis, Sean O'Brien, Shreyas Kadekodi +2
Rotary Positional Encodings (RoPE) are currently the most popular positional encodings used in modern language models. RoPE rotates two-dimensional chunks of query and key vectors,…
cs.AI2025
Truncated Proximal Policy Optimization
Tiantian Fan, Lingjun Liu, Yu Yue +20
Recently, test-time scaling Large Language Models (LLMs) have demonstrated exceptional reasoning capabilities across scientific and professional tasks by generating long chains-of-…