Gradient-based algorithms for multi-objective bi-level optimization

Abstract

Multi-Objective Bi-Level Optimization (MOBLO) addresses nested multi-objective optimization problems common in a range of applications. However, its multi-objective and hierarchical bilevel nature makes it notably complex. Gradient-based MOBLO algorithms have recently grown in popularity, as they effectively solve crucial machine learning problems like meta-learning, neural architecture search, and reinforcement learning. Unfortunately, these algorithms depend on solving a sequence of approximation subproblems with high accuracy, resulting in adverse time and memory complexity that lowers their numerical efficiency. To address this issue, we propose a gradient-based algorithm for MOBLO, called gMOBA, which has fewer hyperparameters to tune, making it both simple and efficient. Additionally, we demonstrate the theoretical validity by accomplishing the desirable Pareto stationarity. Numerical experiments confirm the practical efficiency of the proposed method and verify the theoretical results. To accelerate the convergence of gMOBA, we introduce a beneficial L2O neural network (called L2O-gMOBA) implemented as the initialization phase of our gMOBA algorithm. Comparative results of numerical experiments are presented to illustrate the performance of L2O-gMOBA.

arXiv commentaccepted by SCIENCE CHINA Mathematics

References in corpus (16)

• PyTorch: An Imperative Style, High-Performance Deep Learning Library
• Learning to learn by gradient descent by gradient descent
• Progressive Differentiable Architecture Search: Bridging the Depth Gap between Search and Evaluation
• Bilevel Programming for Hyperparameter Optimization and Meta-Learning
• Forward and Reverse Gradient-Based Hyperparameter Optimization
• Conflict-Averse Gradient Descent for Multi-task Learning
• Self-Tuning Networks: Bilevel Optimization of Hyperparameters using Structured Best-Response Functions
• A Near-Optimal Algorithm for Stochastic Bilevel Optimization via Double-Momentum
• Multi-objective training of Generative Adversarial Networks with multiple discriminators
• Convergence of Meta-Learning with Task-Specific Adaptation over Partial Parameters
• A Distributional View on Multi-Objective Policy Optimization
• On the Iteration Complexity of Hypergradient Computation
• Truncated Back-propagation for Bilevel Optimization
• NSGANetV2: Evolutionary Multi-Objective Surrogate-Assisted Neural Architecture Search
• A Generic First-Order Algorithmic Framework for Bi-Level Programming Beyond Lower-Level Singleton
• Averaged Method of Multipliers for Bi-Level Optimization without Lower-Level Strong Convexity