4 papers · 1 filter
Sharpness-Aware Minimization with Adaptive Regularization for Training Deep Neural Networks
Jinping Zou, Xiaoge Deng, Tao Sun
Sharpness-Aware Minimization (SAM) has proven highly effective in improving model generalization in machine learning tasks. However, SAM employs a fixed hyperparameter associated w…
Federated Prediction-Powered Inference from Decentralized Data
Ping Luo, Xiaoge Deng, Ziqing Wen +2
In various domains, the increasing application of machine learning allows researchers to access inexpensive predictive data, which can be utilized as auxiliary data for statistical…
Score-based Generative Models with Adaptive Momentum
Ziqing Wen, Xiaoge Deng, Ping Luo +2
Score-based generative models have demonstrated significant practical success in data-generating tasks. The models establish a diffusion process that perturbs the ground truth data…
Accelerating Federated Learning by Selecting Beneficial Herd of Local Gradients
Ping Luo, Xiaoge Deng, Ziqing Wen +2
Federated Learning (FL) is a distributed machine learning framework in communication network systems. However, the systems' Non-Independent and Identically Distributed (Non-IID) da…