Regret and Cumulative Constraint Violation Analysis for Distributed Online Constrained Convex Optimization

Abstract

This paper considers the distributed online convex optimization problem with time-varying constraints over a network of agents. This is a sequential decision making problem with two sequences of arbitrarily varying convex loss and constraint functions. At each round, each agent selects a decision from the decision set, and then only a portion of the loss function and a coordinate block of the constraint function at this round are privately revealed to this agent. The goal of the network is to minimize the network-wide loss accumulated over time. Two distributed online algorithms with full-information and bandit feedback are proposed. Both dynamic and static network regret bounds are analyzed for the proposed algorithms, and network cumulative constraint violation is used to measure constraint violation, which excludes the situation that strictly feasible constraints can compensate the effects of violated constraints. In particular, we show that the proposed algorithms achieve $\mathcal{O}(T^{\max \{\kappa ,1-\kappa \}})$ static network regret and $\mathcal{O}(T^{1-\kappa /2})$ network cumulative constraint violation, where $T$ is the time horizon and $\kappa \in (0,1)$ is a user-defined trade-off parameter. Moreover, if the loss functions are strongly convex, then the static network regret bound can be reduced to $\mathcal{O}(T^{\kappa })$. Finally, numerical simulations are provided to illustrate the effectiveness of the theoretical results.

References in corpus (11)

• An Online Convex Optimization Approach to Dynamic Network Resource Allocation
• Online Distributed Optimization on Dynamic Networks
• Trading Regret for Efficiency: Online Convex Optimization with Long Term Constraints
• An Optimal Algorithm for Bandit and Zero-Order Convex Optimization with Two-Point Feedback
• Bandit Convex Optimization for Scalable and Dynamic IoT Management
• Online convex optimization for cumulative constraints
• Online Convex Optimization with Time-Varying Constraints
• Adaptive Online Learning in Dynamic Environments
• Regret and Cumulative Constraint Violation Analysis for Distributed Online Constrained Convex Optimization
• Coordinate Dual Averaging for Decentralized Online Optimization with Nonseparable Global Objectives
• A Low Complexity Algorithm with $O(\sqrt{T})$ Regret and $O(1)$ Constraint Violations for Online Convex Optimization with Long Term Constraints

Cited by in corpus (4)

• Long-Term Energy Management for Microgrid with Hybrid Hydrogen-Battery Energy Storage: A Prediction-Free Coordinated Optimization Framework
• Regret and Cumulative Constraint Violation Analysis for Distributed Online Constrained Convex Optimization
• Online Convex Optimization Using Coordinate Descent Algorithms
• Grid-Aware Real-Time Dispatch of Microgrid with Generalized Energy Storage: A Prediction-Free Online Optimization Approach