4 citations · 7 across the 6 of their papers we have counts for
Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
RoPE at the End of Its Rope? Theory, Diagnosis, and Mitigation of Long-Context Failures
Yuyang Wu, Yufeng Du, Hao Peng
Long-context failures of RoPE-based language models can arise from RoPE's intrinsic tradeoff between maintaining stable token preferences and distinguishing nearby positions. Deter…
cs.LG2024★ 3 cited
A Theoretical Understanding of Self-Correction through In-context Alignment
Yifei Wang, Yuyang Wu, Zeming Wei +2
Going beyond mimicking limited human experiences, recent studies show initial evidence that, like humans, large language models (LLMs) are capable of improving their abilities pure…