activity
20232026
most citedReusing Pretrained Models by Multi-linear Operators for Efficient Training

4 citations · 9 across the 15 of their papers we have counts for

collaborators
Showing 2023Show all

8 papers · 1 filter

cs.LG2023

Topology Learning for Heterogeneous Decentralized Federated Learning over Unreliable D2D Networks

Zheshun Wu, Zenglin Xu, Dun Zeng +2

With the proliferation of intelligent mobile devices in wireless device-to-device (D2D) networks, decentralized federated learning (DFL) has attracted significant interest. Compare…

cs.AI2023

On Diversified Preferences of Large Language Model Alignment

Dun Zeng, Yong Dai, Pengyu Cheng +5

Aligning large language models (LLMs) with human preferences has been recognized as the key to improving LLMs' interaction quality. However, in this pluralistic world, human prefer…

cs.LG2023

Federated Knowledge Graph Completion via Latent Embedding Sharing and Tensor Factorization

Maolin Wang, Dun Zeng, Zenglin Xu +2

Knowledge graphs (KGs), which consist of triples, are inherently incomplete and always require completion procedure to predict missing triples. In real-world scenarios, KGs are dis…

cs.LG2023★ 4 cited

Reusing Pretrained Models by Multi-linear Operators for Efficient Training

Yu Pan, Ye Yuan, Yichun Yin +4

Training large models from scratch usually costs a substantial amount of resources. Towards this problem, recent studies such as bert2BERT and LiGO have reused small pretrained mod…

cs.IT2023

Information-Theoretic Generalization Analysis for Topology-aware Heterogeneous Federated Edge Learning over Noisy Channels

Zheshun Wu, Zenglin Xu, Hongfang Yu +1

With the rapid growth of edge intelligence, the deployment of federated learning (FL) over wireless networks has garnered increasing attention, which is called Federated Edge Learn…

cs.LG2023★ 1 cited

Advocating for the Silent: Enhancing Federated Generalization for Non-Participating Clients

Zheshun Wu, Zenglin Xu, Dun Zeng +2

Federated Learning (FL) has surged in prominence due to its capability of collaborative model training without direct data sharing. However, the vast disparity in local data distri…

cs.LG2023★ 1 cited

On the Power of Adaptive Weighted Aggregation in Heterogeneous Federated Learning and Beyond

Dun Zeng, Zenglin Xu, Shiyu Liu +3

Federated averaging (FedAvg) is the most fundamental algorithm in Federated learning (FL). Previous theoretical results assert that FedAvg convergence and generalization degenerate…

cs.LG2023

Enhanced Federated Optimization: Adaptive Unbiased Client Sampling with Reduced Variance

Dun Zeng, Zenglin Xu, Yu Pan +3

Federated Learning (FL) is a distributed learning paradigm to train a global model across multiple devices without collecting local data. In FL, a server typically selects a subset…