4 papers · 2 filters
Service-Induced Congestion in Memory-Constrained LLM Serving
Ruicheng Ao, Jing Dong, Gan Luo +1
In large language model (LLM) serving, each request accumulates persistent graphics processing unit (GPU) memory during service as its key-value cache grows with every generated to…
The Value of Information in Resource-Constrained Pricing
Ruicheng Ao, Jiashuo Jiang, David Simchi-Levi
Firms that price perishable resources -- airline seats, hotel rooms, seasonal inventory -- now routinely use demand predictions, but these predictions vary widely in quality. Under…
Two-stage Online Reusable Resource Allocation: Reservation, Overbooking and Confirmation Call
Ruicheng Ao, Hengyu Fu, David Simchi-levi
We study a two-stage online reusable resource allocation problem over T days involving advance reservations and walk-ins. Each day begins with a reservation stage (Stage I), where…
Designing Information Delays in Supply Chains
Prem Talwai, Rene Caldentey, Avi Giloni +3
This paper studies how a downstream retailer in a decentralized two-tier supply chain can implicitly transmit demand information to an upstream supplier through the structure of it…