4 citations · 9 across the 15 of their papers we have counts for
15 papers
A Unified Algorithmic Framework for Hybrid Reinforcement Learning in Tabular MDPs with Shifted Transition Dynamics
Zheshun Wu, Renjie Zheng, Jinhang Zuo +2
This paper investigates a hybrid reinforcement learning setting in tabular Markov Decision Processes (MDPs), where an agent aims to learn an optimal policy by combining online inte…
CANS: Accelerating Multiuser Collaborative Edge Inference via Cooperative Autodidactic NeuroSurgeon
Zheshun Wu, Ziyang Zhang, Changyao Lin +2
Recently, mobile edge computing (MEC)-enabled collaborative deep neural network (DNN) inference has emerged as a promising approach for delivering intelligent services to resource-…
Bridging VLMs and Embodied Intelligence with Deliberate Practice Policy Optimization
Yi Zhang, Che Liu, Xiancong Ren +17
Developing a universal and versatile embodied intelligence system presents two primary challenges: the critical embodied data bottleneck, where real-world data is scarce and expens…
IDInit: A Universal and Stable Initialization Method for Neural Network Training
Yu Pan, Chaozheng Wang, Zekai Wu +3
Deep neural networks have achieved remarkable accomplishments in practice. The success of these networks hinges on effective initialization methods, which are vital for ensuring st…
Understanding Generalization of Federated Learning: the Trade-off between Model Stability and Optimization
Dun Zeng, Zheshun Wu, Shiyu Liu +3
Federated Learning (FL) is a distributed learning approach that trains machine learning models across multiple devices while keeping their local data private. However, FL often fac…
Preparing Lessons for Progressive Training on Language Models
Yu Pan, Ye Yuan, Yichun Yin +6
The rapid progress of Transformers in artificial intelligence has come at the cost of increased resource consumption and greenhouse gas emissions due to growing model sizes. Prior…
Cumulative Distribution Function based General Temporal Point Processes
Maolin Wang, Yu Pan, Zenglin Xu +6
Temporal Point Processes (TPPs) hold a pivotal role in modeling event sequences across diverse domains, including social networking and e-commerce, and have significantly contribut…
Topology Learning for Heterogeneous Decentralized Federated Learning over Unreliable D2D Networks
Zheshun Wu, Zenglin Xu, Dun Zeng +2
With the proliferation of intelligent mobile devices in wireless device-to-device (D2D) networks, decentralized federated learning (DFL) has attracted significant interest. Compare…
On Diversified Preferences of Large Language Model Alignment
Dun Zeng, Yong Dai, Pengyu Cheng +5
Aligning large language models (LLMs) with human preferences has been recognized as the key to improving LLMs' interaction quality. However, in this pluralistic world, human prefer…
Federated Knowledge Graph Completion via Latent Embedding Sharing and Tensor Factorization
Maolin Wang, Dun Zeng, Zenglin Xu +2
Knowledge graphs (KGs), which consist of triples, are inherently incomplete and always require completion procedure to predict missing triples. In real-world scenarios, KGs are dis…
Reusing Pretrained Models by Multi-linear Operators for Efficient Training
Yu Pan, Ye Yuan, Yichun Yin +4
Training large models from scratch usually costs a substantial amount of resources. Towards this problem, recent studies such as bert2BERT and LiGO have reused small pretrained mod…
Information-Theoretic Generalization Analysis for Topology-aware Heterogeneous Federated Edge Learning over Noisy Channels
Zheshun Wu, Zenglin Xu, Hongfang Yu +1
With the rapid growth of edge intelligence, the deployment of federated learning (FL) over wireless networks has garnered increasing attention, which is called Federated Edge Learn…
Advocating for the Silent: Enhancing Federated Generalization for Non-Participating Clients
Zheshun Wu, Zenglin Xu, Dun Zeng +2
Federated Learning (FL) has surged in prominence due to its capability of collaborative model training without direct data sharing. However, the vast disparity in local data distri…
On the Power of Adaptive Weighted Aggregation in Heterogeneous Federated Learning and Beyond
Dun Zeng, Zenglin Xu, Shiyu Liu +3
Federated averaging (FedAvg) is the most fundamental algorithm in Federated learning (FL). Previous theoretical results assert that FedAvg convergence and generalization degenerate…
Enhanced Federated Optimization: Adaptive Unbiased Client Sampling with Reduced Variance
Dun Zeng, Zenglin Xu, Yu Pan +3
Federated Learning (FL) is a distributed learning paradigm to train a global model across multiple devices without collecting local data. In FL, a server typically selects a subset…