Online Convex Optimization in Changing Environments and its Application to Resource Allocation
arXiv:2009.14436
Abstract
In the era of the big data, we create and collect lots of data from all different kinds of sources: the Internet, the sensors, the consumer market, and so on. Many of the data are coming sequentially, and would like to be processed and understood quickly. One classic way of analyzing data is based on batch processing, in which the data is stored and analyzed in an offline fashion. However, when the volume of the data is too large, it is much more difficult and time-consuming to do batch processing than sequential processing. What's more, sequential data is usually changing dynamically, and needs to be understood on-the-fly in order to capture the changes. Online Convex Optimization (OCO) is a popular framework that matches the above sequential data processing requirement. Applications using OCO include online routing, online auctions, online classification and regression, as well as online resource allocation. Due to the general applicability of OCO to the sequential data and the rigorous theoretical guarantee, it has attracted lots of researchers to develop useful algorithms to fulfill different needs. In this thesis, we show our contributions to OCO's development by designing algorithms to adapt to changing environments.
arXiv commentphd thesis
References in corpus (10)
- An Online Convex Optimization Approach to Dynamic Network Resource Allocation
- Trading Regret for Efficiency: Online Convex Optimization with Long Term Constraints
- Online convex optimization for cumulative constraints
- Online Learning for Time Series Prediction
- Weighted Linear Bandits for Non-Stationary Environments
- Mirror Descent Meets Fixed Share (and feels no regret)
- Online Optimization with Predictions and Switching Costs: Fast Algorithms and the Fundamental Limit
- Spectral Filtering for General Linear Dynamical Systems
- A Stochastic View of Optimal Regret through Minimax Duality
- Trading-Off Static and Dynamic Regret in Online Least-Squares and Beyond