50 citations · 213 across the 25 of their papers we have counts for
5 papers · 1 filter
Non-ergodic Convergence Analysis of Heavy-Ball Algorithms
Tao Sun, Penghang Yin, Dongsheng Li +3
In this paper, we revisit the convergence of the Heavy-ball method, and present improved convergence complexity results in the convex setting. We provide the first non-ergodic O(1/…
Attention-Guided Answer Distillation for Machine Reading Comprehension
Minghao Hu, Yuxing Peng, Furu Wei +4
Despite that current reading comprehension systems have achieved significant advancements, their promising performances are often obtained at the cost of making an ensemble of nume…
An Efficient ADMM-Based Algorithm to Nonconvex Penalized Support Vector Machines
Lei Guan, Linbo Qiao, Dongsheng Li +3
Support vector machines (SVMs) with sparsity-inducing nonconvex penalties have received considerable attentions for the characteristics of automatic classification and variable sel…
Loss Rank Mining: A General Hard Example Mining Method for Real-time Detectors
Hao Yu, Zhaoning Zhang, Zheng Qin +4
Modern object detectors usually suffer from low accuracy issues, as foregrounds always drown in tons of backgrounds and become hard examples during training. Compared with those pr…
Diagonalwise Refactorization: An Efficient Training Method for Depthwise Convolutions
Zheng Qin, Zhaoning Zhang, Dongsheng Li +2
Depthwise convolutions provide significant performance benefits owing to the reduction in both parameters and mult-adds. However, training depthwise convolution layers with GPUs is…