60 citations · 541 across the 61 of their papers we have counts for
45 papers · 1 filter
FedDA: Faster Framework of Local Adaptive Gradient Methods via Restarted Dual Averaging
Junyi Li, Feihu Huang, Heng Huang
Federated learning (FL) is an emerging learning paradigm to tackle massively distributed data. In Federated Learning, a set of clients jointly perform a machine learning task under…
Communication-Efficient Adam-Type Algorithms for Distributed Data Mining
Wenhan Xian, Feihu Huang, Heng Huang
Distributed data mining is an emerging research topic to effectively and efficiently address hard data mining tasks using big data, which are partitioned and computed on different…
An Accelerated Doubly Stochastic Gradient Method with Faster Explicit Model Identification
Runxue Bao, Bin Gu, Heng Huang
Sparsity regularized loss minimization problems play an important role in various fields including machine learning, data mining, and modern statistics. Proximal gradient descent m…
Balanced Self-Paced Learning for AUC Maximization
Bin Gu, Chenkang Zhang, Huan Xiong +1
Learning to improve AUC performance is an important topic in machine learning. However, AUC maximization algorithms may decrease generalization performance due to the noisy data. S…
Local Stochastic Bilevel Optimization with Momentum-Based Variance Reduction
Junyi Li, Feihu Huang, Heng Huang
Bilevel Optimization has witnessed notable progress recently with new emerging efficient algorithms and has been applied to many machine learning tasks such as data cleaning, few-s…
Distributed Dynamic Safe Screening Algorithms for Sparse Regularization
Runxue Bao, Xidong Wu, Wenhan Xian +1
Distributed optimization has been widely used as one of the most efficient approaches for model training with massive samples. However, large-scale learning problems with both mass…
Desirable Companion for Vertical Federated Learning: New Zeroth-Order Gradient Based Algorithm
Qingsong Zhang, Bin Gu, Zhiyuan Dang +2
Vertical federated learning (VFL) attracts increasing attention due to the emerging demands of multi-party collaborative modeling and concerns of privacy leakage. A complete list o…
A Fully Single Loop Algorithm for Bilevel Optimization without Hessian Inverse
Junyi Li, Bin Gu, Heng Huang
In this paper, we propose a new Hessian inverse free Fully Single Loop Algorithm (FSLA) for bilevel optimization problems. Classic algorithms for bilevel optimization admit a doubl…
AsySQN: Faster Vertical Federated Learning Algorithms with Better Computation Resource Utilization
Qingsong Zhang, Bin Gu, Cheng Deng +4
Vertical federated learning (VFL) is an effective paradigm of training the emerging cross-organizational (e.g., different corporations, companies and organizations) collaborative l…
An Accelerated Variance-Reduced Conditional Gradient Sliding Algorithm for First-order and Zeroth-order Optimization
Xiyuan Wei, Bin Gu, Heng Huang
The conditional gradient algorithm (also known as the Frank-Wolfe algorithm) has recently regained popularity in the machine learning community due to its projection-free property…
Bregman Gradient Policy Optimization
Feihu Huang, Shangqian Gao, Heng Huang
In the paper, we design a novel Bregman gradient policy optimization framework for reinforcement learning based on Bregman divergences and momentum techniques. Specifically, we pro…
Compositional federated learning: Applications in distributionally robust averaging and meta learning
Feihu Huang, Junyi Li
In the paper, we propose an effective and efficient Compositional Federated Learning (ComFedL) algorithm for solving a new compositional Federated Learning (FL) framework, which fr…
Learning Sampling Policy for Faster Derivative Free Optimization
Zhou Zhai, Bin Gu, Heng Huang
Zeroth-order (ZO, also known as derivative-free) methods, which estimate the gradient only by two function evaluations, have attracted much attention recently because of its broad…
Secure Bilevel Asynchronous Vertical Federated Learning with Backward Updating
Qingsong Zhang, Bin Gu, Cheng Deng +1
Vertical federated learning (VFL) attracts increasing attention due to the emerging demands of multi-party collaborative modeling and concerns of privacy leakage. In the real VFL a…
Optimizing Large-Scale Hyperparameters via Automated Learning Algorithm
Bin Gu, Guodong Liu, Yanfu Zhang +2
Modern machine learning algorithms usually involve tuning multiple (from one to thousands) hyperparameters which play a pivotal role in terms of model generalizability. Black-box o…
A New Framework for Variance-Reduced Hamiltonian Monte Carlo
Zhengmian Hu, Feihu Huang, Heng Huang
We propose a new framework of variance-reduced Hamiltonian Monte Carlo (HMC) methods for sampling from an -smooth and -strongly log-concave distribution, based on a unified f…
A Bayesian Federated Learning Framework with Online Laplace Approximation
Liangxi Liu, Xi Jiang, Feng Zheng +4
Federated learning (FL) allows multiple clients to collaboratively learn a globally shared model through cycles of model aggregation and local model training, without the need to s…
CommPOOL: An Interpretable Graph Pooling Framework for Hierarchical Graph Representation Learning
Haoteng Tang, Guixiang Ma, Lifang He +2
Recent years have witnessed the emergence and flourishing of hierarchical graph pooling neural networks (HGPNNs) which are effective graph representation learning approaches for gr…
Improved Bilevel Model: Fast and Optimal Algorithm with Theoretical Guarantee
Junyi Li, Bin Gu, Heng Huang
Due to the hierarchical structure of many machine learning problems, bilevel programming is becoming more and more important recently, however, the complicated correlation between…
Periodic Stochastic Gradient Descent with Momentum for Decentralized Training
Hongchang Gao, Heng Huang
Decentralized training has been actively studied in recent years. Although a wide variety of methods have been proposed, yet the decentralized momentum SGD method is still underexp…
Privacy-Preserving Asynchronous Federated Learning Algorithms for Multi-Party Vertically Collaborative Learning
Bin Gu, An Xu, Zhouyuan Huo +2
The privacy-preserving federated learning for vertically partitioned data has shown promising results as the solution of the emerging multi-party joint modeling application, in whi…
Momentum-Based Policy Gradient Methods
Feihu Huang, Shangqian Gao, Jian Pei +1
In the paper, we propose a class of efficient momentum-based policy gradient methods for the model-free reinforcement learning, which use adaptive learning rates and do not require…
Step-Ahead Error Feedback for Distributed Training with Compressed Gradient
An Xu, Zhouyuan Huo, Heng Huang
Although the distributed machine learning methods can speed up the training of large deep neural networks, the communication cost has become the non-negligible bottleneck to constr…
Fast OSCAR and OWL Regression via Safe Screening Rules
Runxue Bao, Bin Gu, Heng Huang
Ordered Weighted (OWL) regularized regression is a new regression analysis for high-dimensional sparse learning. Proximal gradient methods are used as standard approaches t…