activity
20192023
most citedOn Layer Normalization in the Transformer Architecture

109 citations · 117 across the 6 of their papers we have counts for

collaborators
Showing cs.LGShow all

6 papers · 1 filter

cs.LG2023★ 1 cited

A Reduction-based Framework for Sequential Decision Making with Delayed Feedback

Yunchang Yang, Han Zhong, Tianhao Wu +3

We study stochastic delayed feedback in general multi-agent sequential decision making, which includes bandits, single-agent Markov decision processes (MDPs), and Markov games (MGs…

cs.LG2021

Nearly Optimal Policy Optimization with Stable at Any Time Guarantee

Tianhao Wu, Yunchang Yang, Han Zhong +3

Policy optimization methods are one of the most widely used classes of Reinforcement Learning (RL) algorithms. However, theoretical understanding of these methods remains insuffici…

cs.LG2021★ 2 cited

A Reduction-Based Framework for Conservative Bandits and Reinforcement Learning

Yunchang Yang, Tianhao Wu, Han Zhong +5

In this paper, we present a reduction-based framework for conservative bandits and RL, in which our core technique is to calculate the necessary and sufficient budget obtained from…

cs.LG2020★ 4 cited

(Locally) Differentially Private Combinatorial Semi-Bandits

Xiaoyu Chen, Kai Zheng, Zixin Zhou +3

In this paper, we study Combinatorial Semi-Bandits (CSB) that is an extension of classic Multi-Armed Bandits (MAB) under Differential Privacy (DP) and stronger Local Differential P…

cs.LG2020★ 109 cited

On Layer Normalization in the Transformer Architecture

Ruibin Xiong, Yunchang Yang, Di He +7

The Transformer is widely used in natural language processing tasks. To train a Transformer however, one usually needs a carefully designed learning rate warm-up stage, which is sh…

cs.LG2019★ 1 cited

On the Anomalous Generalization of GANs

Jinchen Xuan, Yunchang Yang, Ze Yang +2

Generative models, especially Generative Adversarial Networks (GANs), have received significant attention recently. However, it has been observed that in terms of some attributes,…