2 papers
cs.PL2026
DVM: A Bytecode Virtual Machine Approach for Dynamic Tensor Computation
Jingzhi Fang, Xiong Gao, Renwei Zhang +6
Dynamism is common in AI computation, e.g., the dynamic tensor shapes and the dynamic control flows in models. Due to the long compilation time, existing runtime compilation damage…
cs.DC2025
Improving the End-to-End Efficiency of Offline Inference for Multi-LLM Applications Based on Sampling and Simulation
Jingzhi Fang, Yanyan Shen, Yue Wang +1
As large language models (LLMs) have shown great success in many tasks, they are used in various applications. While a lot of works have focused on the efficiency of single-LLM app…