activity
20242026
most citedServerlessLLM: Low-Latency Serverless Inference for Large Language Models

7 citations · 13 across the 11 of their papers we have counts for

collaborators
Showing 2026Show all

7 papers · 1 filter

cs.AI2026

HyScale: Scaling Long-Context Training for Learned Sparse Attention

Yangsheng Deng, Yangshen Deng, Xinjing Huang +11

We present HyScale, a long-context training system for learned sparse attention. Learned sparse attention is a promising architecture for million-token contexts, widely adopted in…

cs.CR2026

PIA-Bench: Towards Automated Privacy Impact Assessment with Large Language Models

Jiamin Zheng, Hao-Ping Lee, Luo Mai +1

Privacy impact assessment (PIA) is a critical instrument for institutions to proactively identify privacy risks and develop mitigation strategies before system deployment. While ma…

cs.DC2026

SwarmX: Agentic Scheduling for Low-Latency Agentic Systems

Yeqi Huang, Yanwei Ye, Guomin Chen +8

Agentic AI applications compose multiple model calls and tool executions, creating new scheduling challenges for GPU-CPU clusters. Their inference time and model-call structure oft…

cs.DC2026

BatchGen: An Architecture for Scalable and Efficient Batch Inference

Tairan Xu, Leyang Xue, Zhan Lu +7

Batch inference has become a central mode of AI computation, yet existing inference engines still rely on execution models designed for interactive serving. When scaled to millions…

cs.AI2026

Ryze: Evidence-Enriched Data Synthesis from Biomedical Papers

Yeqi Huang, Yue Chen, Yanwei Ye +2

General-purpose VLMs remain unreliable for biomedical research because valid answers in scientific papers depend on evidence split across figures, tables, charts, captions, and ref…

cs.MA2026

Specialize Roles, Mix Deployments: Pushing the Cost-Accuracy Frontier of LLM Agent Teams

Yinsicheng Jiang, Liang Cheng, Yeqi Huang +6

LLM agents are increasingly deployed as multi-role teams, where tasks are divided across specialized roles such as planner, executor, and verifier. In these systems, cost and accur…

cs.AI2026

Do Agents Know What They Can't Do? Evaluating Feasibility Awareness in Tool-Using Agents

Liang Cheng, Mingsheng Cai, Jiuming Jiang +1

Tool-using agents often incur substantial computational cost due to long reasoning chains and iterative tool usage. In practical scenarios, many tasks become infeasible under const…