2 papers
cs.LG2025
LightSAM: Parameter-Agnostic Sharpness-Aware Minimization
Yifei Cheng, Li Shen, Hao Sun +3
Sharpness-Aware Minimization (SAM) optimizer enhances the generalization ability of the machine learning model by exploring the flat minima landscape through weight perturbations.…
cs.LG2023
Efficient Federated Learning via Local Adaptive Amended Optimizer with Linear Speedup
Yan Sun, Li Shen, Hao Sun +2
Adaptive optimization has achieved notable success for distributed learning while extending adaptive optimizer to federated Learning (FL) suffers from severe inefficiency, includin…