7 papers
VoltanaLLM: Energy-Efficient and SLO-Aware Disaggregated LLM Serving via Adaptive Frequency Control and State-Space Routing
Jiahuan Yu, Aryan Taneja, Junfeng Lin +1
The energy cost of Large Language Model (LLM) inference is rapidly becoming a barrier to sustainable and scalable deployment. Although modern serving architectures expose distinct…
SuperInfer: SLO-Aware Rotary Scheduling and Memory Management for LLM Inference on Superchips
Jiahuan Yu, Mingtao Hu, Zichao Lin +1
Large Language Model (LLM) serving faces a fundamental tension between stringent latency Service Level Objectives (SLOs) and limited GPU memory capacity. When high request rates ex…
State Space Estimation for DPOR-based Model Checkers(Extended Version)
A. R. Balasubramanian, Mohammad Hossein Khoshechin Jorshari, Rupak Majumdar +2
We study the estimation problem for concurrent programs: given a bounded program , estimate the number of Mazurkiewicz trace-equivalence classes induced by its interleavings. Th…
Efficient Dynamic Algorithms to Predict Short Races
Minjian Zhang, Mahesh Viswanathan
We introduce and study the problem of detecting short races in an observed trace. Specifically, for a race type , given a trace and window size , the task is to determin…
InstantEdit: Text-Guided Few-Step Image Editing with Piecewise Rectified Flow
Yiming Gong, Zhen Zhu, Minjia Zhang
We propose a fast text-guided image editing method called InstantEdit based on the RectifiedFlow framework, which is structured as a few-step editing process that preserves critica…
VQ-LLM: High-performance Code Generation for Vector Quantization Augmented LLM Inference
Zihan Liu, Xinhao Luo, Junxian Guo +11
In this work, we design and implement VQ-LLM, an efficient fused Vector Quantization (VQ) kernel generation framework. We first introduce a software abstraction called codebook cac…