Guaranteed Non-convex Optimization: Submodular Maximization over Continuous Domains
arXiv:1606.05615
Abstract
Submodular continuous functions are a category of (generally) non-convex/non-concave functions with a wide spectrum of applications. We characterize these functions and demonstrate that they can be maximized efficiently with approximation guarantees. Specifically, i) We introduce the weak DR property that gives a unified characterization of submodularity for all set, integer-lattice and continuous functions; ii) for maximizing monotone DR-submodular continuous functions under general down-closed convex constraints, we propose a Frank-Wolfe variant with approximation guarantee, and sub-linear convergence rate; iii) for maximizing general non-monotone submodular continuous functions subject to box constraints, we propose a DoubleGreedy algorithm with approximation guarantee. Submodular continuous functions naturally find applications in various real-world settings, including influence and revenue maximization with continuous assignments, sensor energy management, multi-resolution data summarization, facility location, etc. Experimental results show that the proposed algorithms efficiently generate superior solutions compared to baseline algorithms.
Appears in the 20th International Conference on Artificial Intelligence and Statistics (AISTATS) 2017
References in corpus (9)
- Near-optimal Nonmyopic Value of Information in Graphical Models
- Submodular meets Spectral: Greedy Algorithms for Subset Selection, Sparse Approximation and Dictionary Selection
- Variance Reduction for Faster Non-Convex Optimization
- On Graduated Optimization for Stochastic Non-Convex Problems
- Fast Incremental Method for Nonconvex Optimization
- Submodular Functions: from Discrete to Continous Domains
- Deep Submodular Functions
- A Reduction for Optimizing Lattice Submodular Functions with Diminishing Returns
- Maximizing Monotone Submodular Functions over the Integer Lattice
Cited by in corpus (18)
- Guarantees for Greedy Maximization of Non-submodular Functions with Applications
- Online Continuous Submodular Maximization
- Gradient Methods for Submodular Maximization
- Optimal Algorithms for Continuous Non-monotone Submodular and DR-Submodular Maximization
- Projection-Free Online Optimization with Stochastic Gradient: From Convexity to Submodularity
- Decentralized Submodular Maximization: Bridging Discrete and Continuous Settings
- One Sample Stochastic Frank-Wolfe
- Optimal DR-Submodular Maximization and Applications to Provable Mean Field Inference
- Melding the Data-Decisions Pipeline: Decision-Focused Learning for Combinatorial Optimization
- Conditional Gradient Method for Stochastic Submodular Maximization: Closing the Gap
- Parallel Algorithm for Non-Monotone DR-Submodular Maximization
- Distributionally Robust Submodular Maximization
- A Parallel Double Greedy Algorithm for Submodular Maximization
- Online Continuous DR-Submodular Maximization with Long-Term Budget Constraints
- Joint Continuous and Discrete Model Selection via Submodularity
- Subspace Selection via DR-Submodular Maximization on Lattices
- Competitive Algorithms for Online Budget-Constrained Continuous DR-Submodular Problems
- Gradient Method for Continuous Influence Maximization with Budget-Saving Considerations