activity
20232026
most citedSGLang: Efficient Execution of Structured Language Model Programs

11 citations · 41 across the 16 of their papers we have counts for

collaborators
Showing 2025Show all

6 papers · 1 filter

cs.AI2025

SkyRL-Agent: Efficient RL Training for Multi-turn LLM Agent

Shiyi Cao, Dacheng Li, Fangzhou Zhao +12

We introduce SkyRL-Agent, a framework for efficient, multi-turn, long-horizon agent training and evaluation. It provides efficient asynchronous dispatching, lightweight tool integr…

cs.DC2025

Prism: Cost-Efficient Multi-LLM Serving via GPU Memory Ballooning

Shan Yu, Yifan Qiao, Mingyuan Ma +18

Inference providers must maintain availability for many LLMs, including low-volume but essential models, making resource efficiency increasingly important as token prices fall. Ana…

cs.CV2025★ 2 cited

WorldModelBench: Judging Video Generation Models As World Models

Dacheng Li, Yunhao Fang, Yukang Chen +10

Video generation models have rapidly progressed, positioning themselves as video world models capable of supporting decision-making applications like robotics and autonomous drivin…

cs.LG2025

S*: Test Time Scaling for Code Generation

Dacheng Li, Shiyi Cao, Chengkun Cao +6

Increasing test-time compute for LLMs shows promise across domains but remains underexplored in code generation, despite extensive study in math. In this paper, we propose S*, the…

cs.AI2025

LLMs Can Easily Learn to Reason from Demonstrations Structure, not content, is what matters!

Dacheng Li, Shiyi Cao, Tyler Griggs +9

Large reasoning models (LRMs) tackle complex reasoning problems by following long chain-of-thoughts (Long CoT) that incorporate reflection, backtracking, and self-validation. Howev…

cs.DC2025

Locality-aware Fair Scheduling in LLM Serving

Shiyi Cao, Yichuan Wang, Ziming Mao +10

Large language model (LLM) inference workload dominates a wide variety of modern AI applications, ranging from multi-turn conversation to document analysis. Balancing fairness and…