4 papers · 1 filter
Service-Induced Congestion in Memory-Constrained LLM Serving
Ruicheng Ao, Jing Dong, Gan Luo +1
In large language model (LLM) serving, each request accumulates persistent graphics processing unit (GPU) memory during service as its key-value cache grows with every generated to…
The Value of Information in Resource-Constrained Pricing
Ruicheng Ao, Jiashuo Jiang, David Simchi-Levi
Firms that price perishable resources -- airline seats, hotel rooms, seasonal inventory -- now routinely use demand predictions, but these predictions vary widely in quality. Under…
Two-stage Online Reusable Resource Allocation: Reservation, Overbooking and Confirmation Call
Ruicheng Ao, Hengyu Fu, David Simchi-levi
We study a two-stage online reusable resource allocation problem over T days involving advance reservations and walk-ins. Each day begins with a reservation stage (Stage I), where…
Learning to Price with Resource Constraints: From Full Information to Machine-Learned Prices
Ruicheng Ao, Jiashuo Jiang, David Simchi-Levi
We study the dynamic pricing problem with knapsack, addressing the challenge of balancing exploration and exploitation under resource constraints. We introduce three algorithms tai…