11 citations · 24 across the 24 of their papers we have counts for
24 papers
Robust KV Cache Management for LLM Serving under Output Token Length Uncertainty
Jiaming Cheng, Duong The Do, Duong Tung Nguyen
KV cache memory is a primary bottleneck in modern LLM serving systems deployed on GPU clusters. A fundamental challenge is that the KV cache must be reserved upon request arrival,…
Scalable Joint Resource Allocation for SLO-Constrained LLM Inference in Heterogeneous GPU Clouds
Jiaming Cheng, Duong Tung Nguyen
Serving large language model (LLM) inference in cloud environments requires jointly optimizing model selection, GPU provisioning, parallelism configuration, and workload routing un…
Green-LLM: Optimal Workload Allocation for Environmentally-Aware Distributed Inference
Jiaming Cheng, Duong Tung Nguyen
This paper investigates the optimal allocation of large language model (LLM) inference workloads across heterogeneous edge data centers over time. Each data center features on-site…
Robust Dynamic Edge Service Placement Under Spatio-Temporal Correlated Demand Uncertainty
Jiaming Cheng, Duong Thuy Anh Nguyen, Duong Tung Nguyen
Edge computing allows Service Providers (SPs) to enhance user experience by placing their services closer to the network edge. Determining the optimal provisioning of edge resource…
Delay-Aware Robust Edge Network Hardening Under Decision-Dependent Uncertainty
Jiaming Cheng, Duong Thuy Anh Nguyen, Ni Trieu +1
Edge computing promises to offer low-latency and ubiquitous computation to numerous devices at the network edge. For delay-sensitive applications, link delays can have a direct imp…
Constrained multi-cluster game: Distributed Nash equilibrium seeking over directed graphs
Duong Thuy Anh Nguyen, Mattia Bianchi, Florian Dörfler +2
Motivated by the complex dynamics of cooperative and competitive interactions within networked agent systems, multi-cluster games provide a framework for modeling the interconnecte…
Two-Stage Distributionally Robust Edge Node Placement Under Endogenous Demand Uncertainty
Jiaming Cheng, Duong Thuy Anh Nguyen, Duong Tung Nguyen
Edge computing (EC) promises to deliver low-latency and ubiquitous computation to numerous devices at the network edge. This paper aims to jointly optimize edge node (EN) placement…
Optimal Workload Allocation for Distributed Edge Clouds With Renewable Energy and Battery Storage
Duong Thuy Anh Nguyen, Jiaming Cheng, Ni Trieu +1
This paper studies an optimal workload allocation problem for a network of renewable energy-powered edge clouds that serve users located across various geographical areas. Specific…
Nash equilibrium seeking over digraphs with row-stochastic matrices and network-independent step-sizes
Duong Thuy Anh Nguyen, Mattia Bianchi, Florian Dörfler +2
In this paper, we address the challenge of Nash equilibrium (NE) seeking in non-cooperative convex games with partial-decision information. We propose a distributed algorithm, wher…
Quantum-based Distributed Algorithms for Edge Node Placement and Workload Allocation
Duong The Do, Ni Trieu, Duong Tung Nguyen
Edge computing is a promising technology that offers a superior user experience and enables various innovative Internet of Things applications. In this paper, we present a mixed-in…
Distributed Stochastic Optimization with Gradient Tracking over Time-Varying Directed Networks
Duong Thuy Anh Nguyen, Duong Tung Nguyen, Angelia Nedich
We study a distributed method called SAB-TV, which employs gradient tracking to collaboratively minimize the sum of smooth and strongly-convex local cost functions for networked ag…
CrowdCache: A Decentralized Game-Theoretic Framework for Mobile Edge Content Sharing
Duong Thuy Anh Nguyen, Jiaming Cheng, Duong Tung Nguyen +1
Mobile edge computing (MEC) is a promising solution for enhancing the user experience, minimizing content delivery expenses, and reducing backhaul traffic. In this paper, we propos…
Geometric Convergence of Distributed Heavy-Ball Nash Equilibrium Algorithm over Time-Varying Digraphs with Unconstrained Actions
Duong Thuy Anh Nguyen, Duong Tung Nguyen, Angelia Nedich
This paper presents a new distributed algorithm that leverages heavy-ball momentum and a consensus-based gradient method to find a Nash equilibrium (NE) in a class of non-cooperati…
A Bandit Approach to Online Pricing for Heterogeneous Edge Resource Allocation
Jiaming Cheng, Duong Thuy Anh Nguyen, Lele Wang +2
Edge Computing (EC) offers a superior user experience by positioning cloud resources in close proximity to end users. The challenge of allocating edge resources efficiently while m…
A Fairness-Aware Attacker-Defender Model for Optimal Edge Network Operation and Protection
Duong Thuy Anh Nguyen, Jiaming Cheng, Ni Trieu +1
While various aspects of edge computing (EC) have been studied extensively, the current literature has overlooked the robust edge network operations and planning problem. To this e…
Accelerated /Push-Pull Methods for Distributed Optimization over Time-Varying Directed Networks
Duong Thuy Anh Nguyen, Duong Tung Nguyen, Angelia Nedich
This paper investigates a novel approach for solving the distributed optimization problem in which multiple agents collaborate to find the global decision that minimizes the sum of…
AB/Push-Pull Method for Distributed Optimization in Time-Varying Directed Networks
Angelia Nedich, Duong Thuy Anh Nguyen, Duong Tung Nguyen
In this paper, we study the distributed optimization problem for a system of agents embedded in time-varying directed communication networks. Each agent has its own cost function a…
Distributed Nash Equilibrium Seeking over Time-Varying Directed Communication Networks
Duong Thuy Anh Nguyen, Duong Tung Nguyen, Angelia Nedić
This paper proposes a distributed algorithm to find the Nash equilibrium in a class of non-cooperative convex games with partial-decision information. Our method employs a distribu…
A Bilevel Programming Framework for Joint Edge Resource Management and Pricing
Tarannum Nisha, Duong Tung Nguyen, Vijay K. Bhargava
The emerging edge computing paradigm promises to provide low latency and ubiquitous computation to numerous mobile and Internet of Things (IoT) devices at the network edge. How to…
Resilient Edge Service Placement under Demand and Node Failure Uncertainties
Jiaming Cheng, Duong Tung Nguyen, Vijay K. Bhargava
Resiliency plays a critical role in designing future communication networks. How to make edge computing systems resilient against unpredictable failures and fluctuating demand is a…
Two-Stage Robust Edge Service Placement and Sizing under Demand Uncertainty
Duong Tung Nguyen, Hieu Trung Nguyen, Ni Trieu +1
Edge computing has emerged as a key technology to reduce network traffic, improve user experience, and enable various Internet of Things applications. From the perspective of a ser…
A Market-Based Framework for Multi-Resource Allocation in Fog Computing
Duong Tung Nguyen, Long Bao Le, Vijay Bhargava
Fog computing is transforming the network edge into an intelligent platform by bringing storage, computing, control, and networking functions closer to end-users, things, and senso…
Price-based Resource Allocation for Edge Computing: A Market Equilibrium Approach
Duong Tung Nguyen, Long Bao Le, Vijay Bhargava
The emerging edge computing paradigm promises to deliver superior user experience and enable a wide range of Internet of Things (IoT) applications. In this work, we propose a new m…
Optimal Energy Management for SmartGrids Considering Thermal Load and Dynamic Pricing
Duong Tung Nguyen
More active participation of the demand side and efficient integration of distributed energy resources (DERs) such as electric vehicles (trVs), energy storage (ES), and renewable e…