4 papers
ToolSched: Resource-Efficient Tool Scheduling for Shared-Host LLM Agents
Shucheng Zou, Yuhao Gu, Long Chen +3
Local LLM agents often work on shared hosts. Unlike multi-tenant cloud clusters, these hosts often have tightly bounded memory, CPU, and I/O resources. Concurrent agents frequently…
Benchmarks are Not Enough: RAMP for Runtime Assessing of Agentic Models in Production Systems
Yipeng Ouyang, Xin Huang, Bingjie Liu +3
LLM agents are rapidly evolving from coding assistants into autonomous software engineering systems. However, existing evaluation methodologies remain largely centered on static, i…
Partial Cross-Compilation and Mixed Execution for Accelerating Dynamic Binary Translation
Yuhao Gu, Zhongchun Zheng, Nong Xiao +2
With the growing diversity of instruction set architectures (ISAs), cross-ISA program execution has become common. Dynamic binary translation (DBT) is the main solution but suffers…
VecTrans: Enhancing Compiler Auto-Vectorization through LLM-Assisted Code Transformations
Zhongchun Zheng, Kan Wu, Long Cheng +7
Auto-vectorization is a fundamental optimization for modern compilers to exploit SIMD parallelism. However, state-of-the-art approaches still struggle to handle intricate code patt…