45 citations · 209 across the 21 of their papers we have counts for
5 papers · 1 filter
Removing the Feature Correlation Effect of Multiplicative Noise
Zijun Zhang, Yining Zhang, Zongpeng Li
Multiplicative noise, including dropout, is widely used to regularize deep neural networks (DNNs), and is shown to be effective in a wide range of architectures and tasks. From an…
Circular-shift Linear Network Codes with Arbitrary Odd Block Lengths
Qifu Tyler Sun, Hanqi Tang, Zongpeng Li +2
Circular-shift linear network coding (LNC) is a class of vector LNC with low encoding and decoding complexities, and with local encoding kernels chosen from cyclic permutation matr…
A Block-wise, Asynchronous and Distributed ADMM Algorithm for General Form Consensus Optimization
Rui Zhu, Di Niu, Zongpeng Li
Many machine learning models, including those with non-smooth regularizers, can be formulated as consensus optimization problems, which can be solved by the alternating direction m…
Asynchronous Stochastic Proximal Methods for Nonconvex Nonsmooth Optimization
Rui Zhu, Di Niu, Zongpeng Li
We study stochastic algorithms for solving nonconvex optimization problems with a convex yet possibly nonsmooth regularizer, which find wide applications in many practical machine…
Online Job Scheduling in Distributed Machine Learning Clusters
Yixin Bao, Yanghua Peng, Chuan Wu +1
Nowadays large-scale distributed machine learning systems have been deployed to support various analytics and intelligence services in IT firms. To train a large dataset and derive…