activity
20242026
most citedHexiScale: Facilitating Large Language Model Training over Heterogeneous Hardware

2 citations · 2 across the 8 of their papers we have counts for

collaborators
Showing cs.DCShow all

11 papers · 1 filter

cs.DC2026

AReaL-DTE: Sparse Policy-Weight Transfer for Online Agentic Reinforcement Learning

Yingqi Peng, Jiawei Zhang, Wenhao Zhou +7

Online agentic reinforcement learning implemented with micro-services separates policy training from rollout generation, improving scalability and modularity while potentially maki…

cs.DC2026

Next-Generation Agentic Reinforcement Learning Systems Enable Self-Evolving Agents

Ran Yan, Wei Fu, Jiale Li +21

LLM agents are rapidly being deployed in production, including coding assistants, customer-support chatbots, and scientific research assistants, yet they remain fundamentally stati…

cs.DC2026

FSA: An Alternative Efficient Implementation of Native Sparse Attention Kernel

Ran Yan, Youhe Jiang, Zhuoming Chen +3

Recent advances in sparse attention mechanisms have demonstrated strong potential for reducing the computational cost of long-context training and inference in large language model…

cs.DC2026

D^2SD: Accelerating Speculative Decoding with Dual Diffusion Draft Models

Liyuan Zhang, Jiarui Zhang, Jinwei Yao +6

Speculative decoding accelerates autoregressive large language model inference by drafting multiple tokens and verifying them in a single target-model forward pass. Recent diffusio…

cs.DC20262 cited

HexiScale: Facilitating Large Language Model Training over Heterogeneous Hardware

Ran Yan, Youhe Jiang, Xiaonan Nie +3

Training large language models (LLMs) is a computationally intensive task, which is typically conducted in data centers with homogeneous high-performance GPUs. In this paper, we ex…

cs.DC2026

HexiSeq: Accommodating Long Context Training of LLMs over Heterogeneous Hardware

Yan Liang, Youhe Jiang, Ran Yan +3

Long-context training of large language models (LLMs) is commonly distributed with Context Parallelism (CP) and Head Parallelism (HP), but existing training systems largely assume…