2 citations · 2 across the 11 of their papers we have counts for
11 papers
Robust KV Cache Management for LLM Serving under Output Token Length Uncertainty
Jiaming Cheng, Duong The Do, Duong Tung Nguyen
KV cache memory is a primary bottleneck in modern LLM serving systems deployed on GPU clusters. A fundamental challenge is that the KV cache must be reserved upon request arrival,…
Scalable Joint Resource Allocation for SLO-Constrained LLM Inference in Heterogeneous GPU Clouds
Jiaming Cheng, Duong Tung Nguyen
Serving large language model (LLM) inference in cloud environments requires jointly optimizing model selection, GPU provisioning, parallelism configuration, and workload routing un…
Green-LLM: Optimal Workload Allocation for Environmentally-Aware Distributed Inference
Jiaming Cheng, Duong Tung Nguyen
This paper investigates the optimal allocation of large language model (LLM) inference workloads across heterogeneous edge data centers over time. Each data center features on-site…
Robust Dynamic Edge Service Placement Under Spatio-Temporal Correlated Demand Uncertainty
Jiaming Cheng, Duong Thuy Anh Nguyen, Duong Tung Nguyen
Edge computing allows Service Providers (SPs) to enhance user experience by placing their services closer to the network edge. Determining the optimal provisioning of edge resource…
Delay-Aware Robust Edge Network Hardening Under Decision-Dependent Uncertainty
Jiaming Cheng, Duong Thuy Anh Nguyen, Ni Trieu +1
Edge computing promises to offer low-latency and ubiquitous computation to numerous devices at the network edge. For delay-sensitive applications, link delays can have a direct imp…
Two-Stage Distributionally Robust Edge Node Placement Under Endogenous Demand Uncertainty
Jiaming Cheng, Duong Thuy Anh Nguyen, Duong Tung Nguyen
Edge computing (EC) promises to deliver low-latency and ubiquitous computation to numerous devices at the network edge. This paper aims to jointly optimize edge node (EN) placement…
Optimal Workload Allocation for Distributed Edge Clouds With Renewable Energy and Battery Storage
Duong Thuy Anh Nguyen, Jiaming Cheng, Ni Trieu +1
This paper studies an optimal workload allocation problem for a network of renewable energy-powered edge clouds that serve users located across various geographical areas. Specific…
CrowdCache: A Decentralized Game-Theoretic Framework for Mobile Edge Content Sharing
Duong Thuy Anh Nguyen, Jiaming Cheng, Duong Tung Nguyen +1
Mobile edge computing (MEC) is a promising solution for enhancing the user experience, minimizing content delivery expenses, and reducing backhaul traffic. In this paper, we propos…
A Bandit Approach to Online Pricing for Heterogeneous Edge Resource Allocation
Jiaming Cheng, Duong Thuy Anh Nguyen, Lele Wang +2
Edge Computing (EC) offers a superior user experience by positioning cloud resources in close proximity to end users. The challenge of allocating edge resources efficiently while m…
A Fairness-Aware Attacker-Defender Model for Optimal Edge Network Operation and Protection
Duong Thuy Anh Nguyen, Jiaming Cheng, Ni Trieu +1
While various aspects of edge computing (EC) have been studied extensively, the current literature has overlooked the robust edge network operations and planning problem. To this e…
Resilient Edge Service Placement under Demand and Node Failure Uncertainties
Jiaming Cheng, Duong Tung Nguyen, Vijay K. Bhargava
Resiliency plays a critical role in designing future communication networks. How to make edge computing systems resilient against unpredictable failures and fluctuating demand is a…