295 citations · 405 across the 47 of their papers we have counts for
47 papers
Hybrid Offline-Online Multi-Agent Decision Transformers for Wireless Resource Management
Yiming Zhang, Kun Yang, Cong Shen +1
This paper develops a hybrid offline-online multi-agent reinforcement learning framework based on decision transformers. The policy is first pretrained offline via supervised seque…
Efficient Multi-objective Prompt Optimization via Pure-exploration Bandits
Donghao Li, Chengshuai Shi, Weijuan Ou +2
Prompt engineering has become central to eliciting the capabilities of large language models (LLMs). At its core lies prompt selection -- efficiently identifying the most effective…
-Divergence Regularized RLHF: Two Tales of Sampling and Unified Analyses
Di Wu, Chengshuai Shi, Jing Yang +1
Reinforcement Learning from Human Feedback (RLHF) has become a cornerstone technique for post-training large language models. While most existing approaches rely on the reverse KL-…
Greedy Sampling Is Provably Efficient for RLHF
Di Wu, Chengshuai Shi, Jing Yang +1
Reinforcement Learning from Human Feedback (RLHF) has emerged as a key technique for post-training large language models. Despite its empirical success, the theoretical understandi…
From Cross-Task Examples to In-Task Prompts: A Graph-Based Pseudo-Labeling Framework for In-context Learning
Zihan Chen, Song Wang, Xingbo Fu +4
The capability of in-context learning (ICL) enables large language models (LLMs) to perform novel tasks without parameter updates by conditioning on a few input-output examples. Ho…
Augmenting Online RL with Offline Data is All You Need: A Unified Hybrid RL Algorithm Design and Analysis
Ruiquan Huang, Donghao Li, Chengshuai Shi +2
This paper investigates a hybrid learning framework for reinforcement learning (RL) in which the agent can leverage both an offline dataset and online interactions to learn the opt…
On the Convergence Analysis of Muon
Wei Shen, Ruichuan Huang, Minhui Huang +2
The majority of parameters in neural networks are naturally represented as matrices. However, most commonly used optimizers treat these matrix parameters as flattened vectors durin…
Federated Representation Learning in the Under-Parameterized Regime
Renpu Liu, Cong Shen, Jing Yang
Federated representation learning (FRL) is a popular personalized federated learning (FL) framework where clients work together to train a common representation while retaining the…
An Autoencoder-Based Constellation Design for AirComp in Wireless Federated Learning
Yujia Mu, Xizixiang Wei, Cong Shen
Wireless federated learning (FL) relies on efficient uplink communications to aggregate model updates across distributed edge devices. Over-the-air computation (a.k.a. AirComp) has…
Efficient Prompt Optimization Through the Lens of Best Arm Identification
Chengshuai Shi, Kun Yang, Zihan Chen +3
The remarkable instruction-following capability of large language models (LLMs) has sparked a growing interest in automatically finding good prompts, i.e., prompt optimization. Mos…
Advancing RAN Slicing with Offline Reinforcement Learning
Kun Yang, Shu-ping Yeh, Menglei Zhang +3
Dynamic radio resource management (RRM) in wireless networks presents significant challenges, particularly in the context of Radio Access Network (RAN) slicing. This technology, cr…
Harnessing the Power of Federated Learning in Federated Contextual Bandits
Chengshuai Shi, Ruida Zhou, Kun Yang +1
Federated learning (FL) has demonstrated great potential in revolutionizing distributed machine learning, and tremendous efforts have been made to extend it beyond the original foc…
Offline Reinforcement Learning for Wireless Network Optimization with Mixture Datasets
Kun Yang, Cong Shen, Jing Yang +2
The recent development of reinforcement learning (RL) has boosted the adoption of online RL for wireless radio resource management (RRM). However, online RL algorithms require dire…
Federated Linear Bandits with Finite Adversarial Actions
Li Fan, Ruida Zhou, Chao Tian +1
We study a federated linear bandits model, where clients communicate with a central server to solve a linear contextual bandits problem with finite adversarial action sets that…
Stochastic Smoothed Gradient Descent Ascent for Federated Minimax Optimization
Wei Shen, Minhui Huang, Jiawei Zhang +1
In recent years, federated minimax optimization has attracted growing interest due to its extensive applications in various machine learning tasks. While Smoothed Alternative Gradi…
Provably Efficient Offline Reinforcement Learning with Perturbed Data Sources
Chengshuai Shi, Wei Xiong, Cong Shen +1
Existing theoretical studies on offline reinforcement learning (RL) mostly consider a dataset sampled directly from the target task. In practice, however, data often come from seve…
Near-optimal Conservative Exploration in Reinforcement Learning under Episode-wise Constraints
Donghao Li, Ruiquan Huang, Cong Shen +1
This paper investigates conservative exploration in reinforcement learning where the performance of the learning agent is guaranteed to be above a certain threshold throughout the…
Differentially Private Wireless Federated Learning Using Orthogonal Sequences
Xizixiang Wei, Tianhao Wang, Ruiquan Huang +3
We propose a privacy-preserving uplink over-the-air computation (AirComp) method, termed FLORAS, for single-input single-output (SISO) wireless federated learning (FL) systems. Fro…
On High-dimensional and Low-rank Tensor Bandits
Chengshuai Shi, Cong Shen, Nicholas D. Sidiropoulos
Most existing studies on linear bandits focus on the one-dimensional characterization of the overall system. While being representative, this formulation may fail to model applicat…
Reward Teaching for Federated Multi-armed Bandits
Chengshuai Shi, Wei Xiong, Cong Shen +1
Most of the existing federated multi-armed bandits (FMAB) designs are based on the presumption that clients will implement the specified design to collaborate with the server. In r…
Joint Client Assignment and UAV Route Planning for Indirect-Communication Federated Learning
Jieming Bian, Cong Shen, Jie Xu
Federated Learning (FL) is a machine learning approach that enables the creation of shared models for powerful applications while allowing data to remain on devices. This approach…
Accelerating Hybrid Federated Learning Convergence under Partial Participation
Jieming Bian, Lei Wang, Kun Yang +2
Over the past few years, Federated Learning (FL) has become a popular distributed machine learning paradigm. FL involves a group of clients with decentralized data who collaborate…
Federated Learning via Indirect Server-Client Communications
Jieming Bian, Cong Shen, Jie Xu
Federated Learning (FL) is a communication-efficient and privacy-preserving distributed machine learning framework that has gained a significant amount of research attention recent…
Communication and Storage Efficient Federated Split Learning
Yujia Mu, Cong Shen
Federated learning (FL) is a popular distributed machine learning (ML) paradigm, but is often limited by significant communication costs and edge device computation capabilities. F…