Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
ClockRoPE: Random Fourier Rotations for Temporal Routine Modeling
Yiwen Chen, Joshua Ainslie, Krzysztof Choromanski +4
Rotary Position Embedding (RoPE) has been widely adopted in transformer-based large language models. However, its log-linear frequency schedule, originally designed to produce long…
cs.LG2026
dFlowGRPO: Rate-Aware Policy Optimization for Discrete Flow Models
Zhengyan Wan, Yidong Ouyang, Panwen Hu +1
Discrete flow models (DFMs) are a class of flexible generative models for generating discrete data, and diffusion large language models (dLLMs) can be viewed as a special case with…