4 papers · 1 filter
AReaL-DTE: Sparse Policy-Weight Transfer for Online Agentic Reinforcement Learning
Yingqi Peng, Jiawei Zhang, Wenhao Zhou +7
Online agentic reinforcement learning implemented with micro-services separates policy training from rollout generation, improving scalability and modularity while potentially maki…
DualDecoder: Accelerate Long Context LLM Inference by Predictive Prefetch
Zuning Liang, Zhiyi Yao, Qi Chen +6
Long-context inference is becoming a fundamental capability for modern LLM serving, especially driven by emerging agentic applications. Yet it faces a severe memory wall that the K…
Next-Generation Agentic Reinforcement Learning Systems Enable Self-Evolving Agents
Ran Yan, Wei Fu, Jiale Li +21
LLM agents are rapidly being deployed in production, including coding assistants, customer-support chatbots, and scientific research assistants, yet they remain fundamentally stati…
D^2SD: Accelerating Speculative Decoding with Dual Diffusion Draft Models
Liyuan Zhang, Jiarui Zhang, Jinwei Yao +6
Speculative decoding accelerates autoregressive large language model inference by drafting multiple tokens and verifying them in a single target-model forward pass. Recent diffusio…