51 citations · 53 across the 3 of their papers we have counts for
8 papers
NAS-BERT: Task-Agnostic and Adaptive-Size BERT Compression with Neural Architecture Search
Jin Xu, Xu Tan, Renqian Luo +4
While pre-trained language models (e.g., BERT) have achieved impressive results on different natural language processing tasks, they have large numbers of parameters and suffer fro…
Improved Algorithms for Convex-Concave Minimax Optimization
Yuanhao Wang, Jian Li
This paper studies minimax optimization problems , where is -strongly convex with respect to , -strongly concave with respect to and…
TS-RNN: Text Steganalysis Based on Recurrent Neural Networks
Zhongliang Yang, Ke Wang, Jian Li +2
With the rapid development of natural language processing technologies, more and more text steganographic methods based on automatic text generation technology have appeared in rec…
Gradient Boosting With Piece-Wise Linear Regression Trees
Yu Shi, Jian Li, Zhize Li
Gradient Boosted Decision Trees (GBDT) is a very successful ensemble learning algorithm widely used across a variety of applications. Recently, several variants of GBDT training al…
A Simple Proximal Stochastic Gradient Method for Nonsmooth Nonconvex Optimization
Zhize Li, Jian Li
We analyze stochastic gradient algorithms for optimizing nonconvex, nonsmooth finite-sum problems. In particular, the objective function is given by the summation of a differentiab…
Pure Exploration of Multi-armed Bandit Under Matroid Constraints
Lijie Chen, Anupam Gupta, Jian Li
We study the pure exploration problem subject to a matroid constraint (Best-Basis) in a stochastic multi-armed bandit game. In a Best-Basis instance, we are given stochastic ar…