Asynchronous Optimization over Weakly Coupled Renewal Systems
arXiv:1608.00195
Abstract
This paper considers optimization over multiple renewal systems coupled by time average constraints. These systems act asynchronously over variable length frames. For each system, at the beginning of each renewal frame, it chooses an action which affects the duration of its own frame, the penalty, and the resource expenditure throughout the frame. The goal is to minimize the overall time average penalty subject to several overall time average resource constraints which couple these systems. This problem has applications to task processing networks, coupled Markov decision processes(MDPs) and so on. We propose a distributed algorithm so that each system can make its own decision after observing a global multiplier which is updated slot-wise. We show that this algorithm satisfies the desired constraints and achieves near optimality with convergence time.
arXiv comment31 pages
References in corpus (10)
- Power laws, Pareto distributions and Zipf's law
- ARock: an Algorithmic Framework for Asynchronous Parallel Coordinate Updates
- An Online Convex Optimization Approach to Dynamic Network Resource Allocation
- Trading Regret for Efficiency: Online Convex Optimization with Long Term Constraints
- Adaptive Online Prediction by Following the Perturbed Leader
- Online Convex Optimization with Time-Varying Constraints
- Algorithms with Logarithmic or Sublinear Regret for Constrained Contextual Bandits
- Stochastic Primal-Dual Methods and Sample Complexity of Reinforcement Learning
- The Sample-Complexity of General Reinforcement Learning
- A Probabilistic Sample Path Convergence Time Analysis of Drift-Plus-Penalty Algorithm for Stochastic Optimization